"Automate performance optimization at all levels of the AI infrastructure stack."
tldr; nCompass Technologies is building a developer tool that unifies profiling, trace collaboration and trace analysis of AI systems. They automate performance optimization of AI systems across all levels of the infrastructure stack.
Using this tool, nCompass Technologies implemented a Hopper GEMM kernel that outperformed NVIDIA's CUTLASS GEMMs by 3%, within a day - this took months before.
Checkout the product demo below. It’s free to use and you can get started today in VS Code, Cursor or Claude Code - Quick Start.
Identifying the root cause of performance bottlenecks is 4-8x slower than writing the code to fix them.
If you are optimizing a system like vLLM, you have to:
Run a profile and then copy a giant trace file to your local machine just to view it.
Spend hours identifying opportunities for performance improvement.
If this involves writing a kernel, you profile the kernel, spend hours or days digging through ncu traces that are massive data dumps.
Then you identify your bottlenecks and formulate a plan.
Running this loop till you have a performant system can take weeks, even months.
The Solution
By building an AI agent that can analyze profiling data as well as interact with a bank of deep technical knowledge and expertise, nCompass is automating the process of identifying performance bottlenecks.
Now in a single VSCode interface, you can:
Open and view trace files.
Use the nCompass novel tools like trace diffs to analyze them.
Generate share links to easily share traces with team members.
Feed source + profiling data to the nCompass AI agent and get back actionable analysis on how you can optimize the performance of your system.
This applies to both systems and GPU kernel level analysis and the nCompass agent integrates directly into Cursor / Claude Code, so you never have to leave your normal workflow!
Anyone can now write both correct and performant code with AI!
Asks
Install the VSCode extension and start optimizing your systems performance!
nCompass also offers FDE services - if you would like them to step in and analyze your system’s performance and provide you with an analysis of how much nCompass could improve it by - reach out to the founders via email here.
nCompass offers FDE services - if you would like them to step in and analyze your system’s performance and provide you with an analysis of how much nCompass could improve it by - reach out to the founders via email here.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.