Bluetooth

Isaiah was able to ship out the first pass of Bluetooth connectivity through the app, but it needs testing on physical devices to make sure it works. In order to do so, we are going to begin making development builds that we can download onto our phones!

Jeff is beginning the first test, but turns out, building locally on iOS is sort of difficult, so the team has been kind of going through group debugging where we try and figure out what’s going wrong.

Hardware

From last week, I began attempting to program the ESP32 in the most customization way possible, in order to leave as much room for efficiency as possible. This was a bad idea.

Arduino IDE

I’ve moved my development to the Arduino IDE, getting some decent results. First I used an example program to connect to the camera and run it! It worked pretty well, but was significantly slower than we need and not very customization due to having no understanding of how it worked.

I’ve begun development with an efficient solution to the problem. Sending video data as fast as possible securely through a Bluetooth connection.

Technical Strategy

The ESP32 will emit a Bluetooth signal which the app looks for, while the board is connecting to the phone, it will begin hosting a web server the phone will connect to. These are the current credentials below (very safely stored in plaintext in the source on the git page!)

image.png

The phone connects to the web server, which can only be achieved through Bluetooth first, and the web sever streams the video through MJPEG frames.

Checkpoint 1

We’re all extremely excited to show off all the work we’ve done so far! We’re also taking this opportunity to reorganize a little bit as we near the halfway point of our project.

Everyone’s passion has driven us towards constant progress towards our end product, but we’ve encountered some small issues due to some organizational problems, like accidentally working on the same thing twice.

To remedy this, we’re moving to have weekly meetings. This will help us not only stay coordinated but also is a good opportunity to ask for help. It’s only more recently that we’ve been sending error messages in our group and kind of group debugging something together, and its been extremely beneficial for our progress.

Building to Hardware

After countless of hours of debugging, we have finally found a way to build onto devices locally. This is through expo, there is a command that can be run to build aiSight onto phones regardless of propriety or expensive development kits cough cough APPLE cough cough. Thank you to Jeff and Isaiah for your diligence in this process

While in the app on his phone, this is what Jeff’s console outputs

image.png