Links
Inspiration
After hours of staring at course slideshows, your brain just crashes and refuses to accept any knowledge or understand any more concepts. There will always be that one concept we just never fully understood or grasped lingering at the back of our mind. But sometimes, you just need a visual to aid your understanding, especially for STEM courses. Thus, our team came to the conclusion that engaging students through visual storyboards would be a more effective approach to learning!
What it Does
STEMToons is a website that allows for users to upload any STEM course content in the form of files (max 3) or instant photos, and our website generates and presents the course content in a visually appealing and intriguing way through a mini comic and storyboard.
How We Built It
The frontend is created using Typescript and React.js and the tool we are using for HMR is Vite. The backend is a combination of Typescript, Express, and OpenAI APIs in order to process and serve contents needed to our React frontend.
Challenges We Ran Into
Difficult finding a good OCR because many were too slow, inaccurate, or too expensive. Also pretty difficult to get the camera working on cross platforms. We first got it to work on the computer but it wasn’t showing results on mobile.
Accomplishments That We're Proud Of
We are proud that we could establish our pipeline from OpenAI to our storyboard content, and how we were able to integrate our sponsors like Neurelo alongside MongoDB.
What We Learned
We learned sleep is important and ideation takes a really long time. Other than that, many of our group members learned how easily it is to integrate already existing AI into projects!
What's Next?
In the future, we plan to continue branching out into more courses, including: english, history, law, etc. and hopefully extending the website to not only STEM-related courses. We also had the idea to implement a time organizer within the website, and so that is also something that could be integrated and updated in the future.
Our Devposts