Writing this 20 minutes in: The previous bug can be seen below in the logs from Weights and Biases of the 2nd image. I'm using 4x Nvidia A100 to train my own custom GPT model, i.e. GPTesla. Previously managed to solve the issue of only 1 out of the 4 gpu running. Turns out i was using it entirely wrong, as in running the "Accelerate" framework completely wrong and messing upp the config files. Now I've also fixed an issue with only 1x of my AMD core being used, rather than all 96 cores being used. And it's working a lot faster now.
• now just trying to get it to train 50k steps.
github.com/Ice-Citron/GPTesla/commit/a105bbc2182d59f09b4bb8e3de6ab7682a2287c4huggingface.co/shng2025/gptesla-small/tree/robust-snowball-115 (115th run. Can be seen at Weights and Biases)
Design 1 done. actually finished this a while ago but forgot. Texture is just mainly using a metal texture. background is a white box thats set to full reflective.
Renderede photo can be seen which will be placed in portfolio soon. Will work on sketching V2 and then doing blender all over again. hella fun
that shall be it for concept art for design 1. I will need to crop them, and then annotate them in the end when I work on the engineering portfolio. Which I reckon will be at the end. After lunch, and after my orals practice for my coursework Malay test. I will work on the blender render for Design 1!
more drawings for now. Mostly done. on the right are the control panel prototype? Upon further discussion this design is kinda impractical and will likely be scrapped but lets see.
first concept sketch done. still trying to get a few more for more details. :\
signing up f1 in schools team because my teacher hasn't done so and was too lazy. and also writing sponsorship email now based on the draft given from UoRM
