Local AI model for 8 GB vram
Author: junaeed365-pngCreated Jun 26, 2026Updated Aug 16, 2026
Can anyone tell me which local AI models are best to run as agent or chatbot assistant on a 8gb vram/16gb ram computer for cybersecurity tasks(abliterated)? Most efficient and accurate with more data.
Environment: Cachy OS Ollama-Docker
Hardware Specification: Core ultra 7 155H LPDDR5 16 GB RAM- 6400 MT/S RTX 4070 mobile 8 GB VRAM (125MGP) 1 TB SSD 7300 MB/s (Acer Predator Helios Neo 14 AI)
Field of study: Main- Computer Science and Engineering(B.Sc.) Sub- Machine Learning, Data Science, Cybersecurity(Main focus)
Source: Stability-AI/generative-models