Run Axolotl on Novita AI

​

How to Use Axolotl:main-latest on Novita AI

• Click Get Started to access the GPU Instance console.

• Browse various official templates and GPU card options.
• Select the Axolotl:main-latest template.
• Click Deploy under the 4090 GPU card to proceed to the instance creation page.

• In the Disk section, adjust the size of the system disk and local disk.
• In the Configuration section, modify settings such as the image, startup commands, ports, and environment variables.
• Check the box for Start Jupyter Notebook to launch Jupyter.

• Review the instance configuration and costs on the confirmation page.
• Click Deploy to start the deployment process.

• Wait for the instance to finish deploying.

• Once deployment is complete, the system will redirect you to the Instance Management page.
• Locate your newly created instance, which will initially show a Pulling status (indicating the image is being downloaded).
• Click the small arrow on the right side of the instance to view details.
• Monitor the image pull progress. Once complete, the instance will transition to Running status.
• Click Logs to view deployment logs.

• Go to the Instance Logs tab to check if the service is starting.
• Wait for the service to finish initializing.

• Close the logs page.
• Click Connect to open the connection information page.
• Locate the Connection Options section and click Connect to Jupyter Lab to access the Jupyter interface.

• Wait for the Jupyter Lab web interface to load.
• Open Terminal to run an official example and verify the service is working correctly.

• Execute the official example code to perform a fine-tuning task.

# Fetch axolotl examples
axolotl fetch examples

# Or, specify a custom path
axolotl fetch examples --dest path/to/folder

# Train a model using LoRA
axolotl train examples/llama-3/lora-1b.yml