KINETIC POIESIS

Project Name:

Kinetic Poiesis: Greek phrase representing art, creation and movement. 

Team

• Valentín Martínez Rojas [Full Stack Developer & Designer]
  
  

• Project Description:
  
   Kinetic Poetry addresses the challenge of capturing and celebrating human movement through real-time body pose detection. Our solution utilizes advanced machine learning technologies to provide an interactive platform where users can analyze and engage with their movements. Additionally, we integrate NFT minting capabilities to allow users to share and monetize their videos on a blockchain-based marketplace.

• Objectives:

  • Develop a user-friendly application for real-time body pose detection.
  • Implement NFT minting functionality for users to create digital assets from their videos.
  • Foster a community around the appreciation of movement and creativity.
  • Provide a seamless integration of blockchain and AI technologies for enhanced user experience.

• Technologies Used:

  • Artificial Intelligence: ML5.js and TensorFlow.js [BodyPose Model] for real time body tracking and analysis.
  • Blockchain: Mintbase for NFT minting and Bitte Wallet for digital wallet management.
  • Frontend: Next.js and React for building a responsive web application.

• Project Architecture:
  
  The project architecture consists of a frontend application built with Next.js and TailwindCSS, which interacts with TensorFlow ML model through ML5.js library for real-time pose detection.

•  The NFT minting process is facilitated through the Mintbase API, and user wallet connections are handled via Bitte Wallet.

• Use Cases:

  • Dancers and Athletes: Users can track their movements and improve their performance through real-time feedback.
  • Content Creators: Users can mint their dance, yoga, or sports videos as NFTs, allowing them to share and sell their unique content.
  • Fitness Enthusiasts: The platform encourages users to explore their physical capabilities and engage with interactive content.

• Implementation:
  
  The main steps for implementation included:

  • Setting up the development environment and choosing the tech stack.
  • Building the frontend application and integrating ML5.js for pose detection.
  • Implementing the NFT minting feature using Mintbase and Bitte Wallet.

• Current Status:
  
  Webpacks for ML5 are complicated to sync with Vercel so current online development doesn't have the BodyPose feature (Even though in localhost is working correctly). Also the Mbwallet integration has been outdated and the @mintbase-js/react is not able to fetch  "import { useMbWallet }" therefore local Bitte Wallet implementation is still on development. 

   Next Steps: The project is currently in development stage, with core functionalities being  implemented and tested for online deployment. Next steps include enhancing the user interface; adding a function to save the videos generated locally and other interactive features, as the HandPose ML5 library to choose and customize the video-art options with hand signs.  Also improving the overall performance of the body pose detection; and creating an appropiate store and contract scheme on MintBase to storage the NFT- Kinetic Poetry users create and allow them to monetize their art. 
  
  For roadmap and business model the users could select a weekly video that outstands and be uploaded to TikTok, giving rewards and visibility to the content creator and to Kinetic Poiesis platform. 

----

• (I know you want to test it!, since webpack errors are being mean to this project, I created the component on CodePen in case you want to see it in action!)  BodyPose Tracker - ML - TensorFlow:  https://codepen.io/ValenteCreativo/pen/eYqeKBW

• Website: [ https://kinetic-poiesis.vercel.app/ ] (unfortunately something happened with my design that Vercel is not recognizing my CSS styles :/ ) 

• Code Repository: [ https://github.com/ValenteCreativo/Kinetic-Poiesis ]

• Contact: https://t.me/ValeCreativo

• Email: [email protected]

• LinkedIn: [ https://www.linkedin.com/in/valentinmartinezmx/ ] 

Come on, we gotta move, we gotta dance, we gotta practice... We gotta create art together!