/series/capstone/ Recent content in Capstone on Hugo -- gohugo.io en-us Tue, 06 Oct 2026 23:45:18 -0400 /posts/capstone/eval_with_evidenceforge/ Tue, 06 Oct 2026 23:45:18 -0400 /posts/capstone/eval_with_evidenceforge/ Benchmarking Models with EvidenceForge Alright, so previously we did some hardware benchmarking to validate that our selected models could reasonable run on my current hardware. Those tests all went well, which was good, but now we are getting into the real meat and potatoes of this project. Evaluating these models security reasoning skills. How are we going to go about doing that? Well, I’m glad you asked. Enter, EvidenceForge. EvidenceForge is an open-source project from Cisco Talos that can generate synthetic security telemetry from scenario definitions, keeps the generated evidence separate from the answer key, and gives me a much better basis for comparing local models than a few improvised chat prompts. /posts/capstone/llama_cpp_cuda/ Tue, 06 Oct 2026 23:43:21 -0400 /posts/capstone/llama_cpp_cuda/ Using llama.cpp with CUDA and Testing Local Models Howdy there everyone and welcome back to the next leg of my capstone journey. Which involves actually spinning up some locally hosted models and testing them out. Over the next while, we’re going to be deploying a few models, seeing how they run on my old RTX 2060 laptop, benchmarking their security reasoning skills and their ability to call tools from a MCP server. /posts/capstone/shuffle_soar/ Tue, 06 Oct 2026 23:41:40 -0400 /posts/capstone/shuffle_soar/ Introduction Last time, we deployed Security Onion which will be our SIEM of choice for this project. Now we need a SOAR (Security Orchestration Automation and Response) solution. Which brings us to Shuffle, an open-source SOAR platform we can use to build playbooks containing predefined actions for responding to suspicious activity. Before we get going, I’m deploying Shuffle on a recently created Ubuntu server VM using Docker Compose. Versions listed below. /posts/capstone/security_onion/ Tue, 06 Oct 2026 23:38:51 -0400 /posts/capstone/security_onion/ Introduction Alright, time to get down to some serious business. From this point forward, all of my blog posts will be in support of my master’s degree capstone. I may be a little less chatty than I normally am for a while as my main focus is just getting these rolled out in a timely fashion. These posts will still go over what we’re deploying and how we’re doing it and there’s going to be a little more information on things like version numbers and any issues we run into or anything during deployment.