AI-Tools started with a vision to be the Open Source version of Amazon Sage Maker - Provide Infrastructure Management and Deployment Optimization as a service. This process will abstract many stages of deployment and hence will allow AI engineers to only focus on the development work.
Work Already Done:
AI-Tools were already supporting a few AI workflows such as Text Translation, Language Detection, etc. Each Image also comes with a docker image for containerizing the application.
AI-Tools bundles all the images together by generating a docker-compose file dynamically and deploying it. All the images are served via an NginX proxy.
The Objective is to enable Multi Image Deployment Seamlessly.
I picked some tasks that aid this major plan:
Upgraded the shell script that generates a docker-compose file that references the existing docker images in every AI workflow model. Here is the PR https://github.com/Samagra-Development/ai-tools/pull/122
GitHub Actions. I created a GitHub workflow that builds the images from the codebase and pushes them to GitHub Packages as a Public Image. Here is the PR https://github.com/Samagra-Development/ai-tools/pull/123
End Goal:
The Mission is to develop a system that can work like Amazon Sage Maker. Over the coming weeks, I will try to identify the salient features of this product and formulate a plan on how to implement them.
Relevant Technologies I identified: for the upcoming weeks
Packer - To bundle the Images
Kubernetes - To Orchestrate the Images
KubeFlow - Optimize Machine Learning Training Process
ReactAdmin - A dashboard to visualize the Training and Deployment Process
Thoughts
It is important to visualize the process and that Is what I think I did this week. I understood what we have right now and what we want to be. Realizing the process needs patience and tenacity as it might not go as planned. At the present, I have visualized a few intermediate milestones between the present and the end goal. I'll strive to stick to them but will also be open to other approaches during the process
