Scott Williams

About Me

Scott Williams Profile Picture

Hi, I'm Scott, a Forward Deployed Engineer at Tenex (5th Engineer), based in New York City. I lead client-facing AI workflow and data engineering engagements, mainly focused on automating financial work and improving team efficiency. My recent independent work spans self-hosted operations, full-stack development, and GCP-based data pipelines applied to projects ranging from social media automation to personal finance research.

I learn and operate best by building. Recent projects include a data pipeline for automating arbitrage trades on Kalshi's prediction markets using order book and weather data, an AI-based video appraisal system, an MCP server for LLM debugging, tooling for rapidly deploying VPS-based full-stack applications, and LangGraph-based AI agents and workflows. These projects have deepened my expertise in cloud architecture, AI engineering, infrastructure as code, and end-to-end system design.

From June 2025 through January 2026, I worked as a Data Engineer at iCapital in New York City on the Data & Analytics team. I played a pivotal role in migrating mission-critical integrations from Airflow to Prefect and architected a Kafka-based streaming ingestion solution to bring real-time data from the platform into our data infrastructure.

I hold a Bachelor of Science in Computer Science and Applied Mathematics from the Colorado School of Mines. My academic background gave me a strong foundation in CS theory and its mathematical underpinnings, knowledge that continues to inform my work in the AI/ML space.

Outside of work, I'm a lifelong athlete. I've played hockey since age six and captained the rowing team at The Taft School. I also enjoy poker, hiking, running, and keeping up with AI research.

Thanks for visiting. Feel free to connect through the links above.

Work Experience

Awards

Projects

Skills

Programming Languages:

C++, Java, Python, OCaml, TypeScript, Jinja2, R, Ruby, Go

Data Management:

PostgreSQL, Databricks, Snowflake, dbt, Spark, Vector Databases, Airflow, MongoDB, Prefect

Cloud Architecture:

AWS, GCP, Azure, Terraform (IaC)

Enterprise Software:

Salesforce, NetSuite, Coupa

ML and Statistical Modeling:

TensorFlow, Scikit-learn, SciPy, OpenCV, Time Series Analysis, Transformers (Hugging Face)

Agent Frameworks:

Claude Agent SDK, LangGraph, Flue, Cortex, Genie

Mobile/Web Apps:

Expo (iOS), Next.js (web), Vite (web)

Education

Articles