AI & ML Infrastructure on Elixir/BEAM
Building core AI and ML infrastructure libraries primarily on the BEAM platform. Creator of Crucible Framework for LLM reliability research.
Ingot Data Labeling
Sample factory library for generating, transforming, and computing measurements on samples
View on GitHub →Phoenix LiveView interface for sample generation and human labeling workflows
View on GitHub →Shared IR structs for the North Shore labeling stack (Forge/Anvil/Ingot) — typed datasets, samples, assignments, labels, artifacts, and evaluation runs for labeling workflows
View on GitHub →AI Agent Orchestration
Headless, declarative multi-agent orchestration framework with a domain-agnostic signal bus, workflow engine with Postgres persistence, and configurable agent runtime (ships code review domain).
View on GitHub →DSPEx - Declarative Self-improving Elixir | A BEAM-Native AI Program Optimization Framework
View on GitHub →Asset-first data orchestration for Elixir/BEAM. Dagster-inspired with OTP fault tolerance, LiveView dashboard, lineage tracking, checkpoint gates, and distributed execution via Oban.
View on GitHub →Multi-agent systems framework for the BEAM platform - build distributed autonomous agents with OTP supervision and fault tolerance
View on GitHub →Synapse integration for altar_ai - SDK-backed LLM providers for multi-agent workflows with automatic fallback, signal handlers, and workflow actions
View on GitHub →AI SDKs & API Clients
Elixir Interface / Adapter for Google Gemini LLM, for both AI Studio and Vertex AI
View on GitHub →An Elixir SDK for Claude Code - provides programmatic access to Claude Code CLI with streaming message processing
View on GitHub →Protocol-based AI adapter foundation for Elixir - unified abstractions for gemini_ex, claude_agent_sdk, codex_sdk with automatic fallback, capability detection, and telemetry
View on GitHub →Full-featured Elixir client for the Model Context Protocol (MCP) with multi-transport support, resources, prompts, tools, and telemetry.
View on GitHub →AI Infrastructure
A practical, multi-layered JSON repair library for Elixir that intelligently fixes malformed JSON strings commonly produced by LLMs, legacy systems, and data pipelines.
View on GitHub →High-performance, generalized process pooler and session manager for external language integrations. Orchestrates and supervises languages like Python and Javascript from Elixir.
View on GitHub →Elixir SDK for the Tinker ML platform—LoRA training, sampling, and service orchestration built on OTP, Finch, and telemetry.
View on GitHub →FlowStone integration for altar_ai - AI-powered data pipeline assets with classify_each, enrich_each, embed_each helpers and unified telemetry
View on GitHub →Elixir implementation of GEPA: LLM-driven evolutionary optimization using Pareto-efficient search for text-based systems. Features OpenAI/Gemini integration, BEAM concurrency, OTP supervision, 218 tests with 75% coverage.
View on GitHub →Unified API gateway for the NSAI ecosystem—authentication (JWT, API keys, OAuth2/OIDC), distributed rate limiting with burst allowance, circuit breakers, request tracing, Prometheus metrics, and service proxying. Production-ready with comprehensive observability and multi-tenant support.
View on GitHub →Service discovery and registry for the NSAI ecosystem—distributed registry with health checking, circuit breakers, multiple storage backends (ETS/PostgreSQL), PubSub event broadcasting, and comprehensive telemetry. Built on OTP with Horde-ready architecture for multi-node deployments.
View on GitHub →Interactive CLI and REPL for the NSAI ecosystem—unified interface to registry, gateway, jobs, experiments, datasets, embeddings, and metrics services; tab completion with bash/zsh scripts; configurable environments; JSON output mode for scripting; escript distribution. The cockpit for North Shore AI operations.
View on GitHub →Configuration-driven Python library integration for Elixir. Automatically generate type-safe Elixir modules from declarative configs with zero wrapper code. Bridge to Python ML ecosystem (DSPy, NumPy, LangChain) with streaming support, bidirectional tools, and compile-time optimization. Built on Snakepit.
View on GitHub →Pure Elixir TikToken-style byte-level BPE tokenizer (Kimi K2 compatible).
View on GitHub →Chiral Narrative Synthesis workspace for Thinker/Tinker LoRA pipelines, semantic fact-checking, telemetry, and reviewer-ready CNS docs.
View on GitHub →Elixir client for HuggingFace Hub—dataset/model metadata, file downloads, caching, and authentication. The BEAM-native foundation for HF ecosystem ports.
View on GitHub →Schema & Validation
A powerful, flexible schema definition and validation library for Elixir, inspired by Python's Pydantic.
View on GitHub →Advanced typing and type validation mechanism for Elixir - runtime type checking and contract enforcement for BEAM applications
View on GitHub →Developer Tools
State-of-the-Art Introspection and Debugging System for Elixir/Phoenix Applications
View on GitHub →Revolutionary AST-based debugging and code intelligence platform for Elixir applications
View on GitHub →A Phoenix LiveView performance monitoring dashboard for tracking slow endpoints and database queries
View on GitHub →OTP & Distributed
Metaprogramming framework for automatic REST API generation from OTP operations
View on GitHub →Testing & QA
A battle-hardened testing toolkit for building robust and resilient Elixir & OTP applications.
View on GitHub →Observability
Browser Integration
Data & Databases
Vector embeddings service for Elixir—multi-provider support (OpenAI, Cohere, Voyage AI), intelligent caching with Cachex, batch processing with rate limiting, Nx-powered similarity computations, k-means/DBSCAN clustering, semantic deduplication, and ETS-based vector storage. Built for CNS and ML pipelines.
View on GitHub →Modern Elixir client for Weaviate vector database with health checks and friendly error messages
View on GitHub →Pure Elixir library for graph topology, TDA, and computational topology
View on GitHub →Composable regularization penalties for Elixir Nx. L1/L2/Elastic Net, KL divergence, entropy, consistency, gradient penalty, orthogonality. Pure Nx.Defn for JIT across EXLA/Torchx. Pipeline composition and Axon.Loop integration.
View on GitHub →Security
GUARDRAIL - MCP Security - Gateway for Unified Access, Resource Delegation, and Risk-Attenuating Information Limits
View on GitHub →Post-quantum cryptographic implementation of HQC (Hamming Quasi-Cyclic) - a NIST PQC candidate for quantum-resistant key encapsulation using code-based cryptography
View on GitHub →Research
Chiral Narrative Synthesis - Dialectical reasoning framework for automated knowledge discovery
View on GitHub →Utilities
Utility library and helper functions for Elixir development - common patterns, debugging aids, and productivity tools
View on GitHub →Download high-quality audio from YouTube as MP3 files using Elixir. Features 104 music genres, duration filtering, per-genre caching, C++ DSP filters, and ML-based transient detection.
View on GitHub →AI-native personal project intelligence system - manage, track, and search across all your repositories with semantic understanding
View on GitHub →Crucible Framework
A platform for conducting reproducible experiments on large language model reliability, built on Elixir/OTP.
Interactive Phoenix LiveView demonstrations of the Crucible Framework - showcasing ensemble voting, request hedging, statistical analysis, and more with mock LLMs
View on GitHub →Adversarial testing and robustness evaluation for the Crucible framework
View on GitHub →CrucibleFramework: A scientific platform for LLM reliability research on the BEAM
View on GitHub →Experimental research framework for running AI benchmarks at scale
View on GitHub →Request hedging for tail latency reduction in distributed systems
View on GitHub →Dataset management library for ML experiments—loaders for SciFact, FEVER, GSM8K, HumanEval, MMLU, TruthfulQA, HellaSwag; git-like versioning with lineage tracking; transformation pipelines; quality validation with schema checks and duplicate detection; GenStage streaming for large datasets. Built for reproducible AI research.
View on GitHub →Model evaluation harness for standardized benchmarking—comprehensive metrics (F1, BLEU, ROUGE, METEOR, BERTScore, pass@k), statistical analysis (confidence intervals, effect size, bootstrap CI, ANOVA), multi-model comparison, and report generation. Research-grade evaluation for LLM and ML experiments.
View on GitHub →Metrics aggregation and alerting for ML experiments—multi-backend export (Prometheus, InfluxDB, Datadog, OpenTelemetry), advanced aggregations (percentiles, histograms, moving averages), threshold-based alerting with anomaly detection (z-score, IQR), and time-series storage. Research-grade observability for the NSAI ecosystem.
View on GitHub →Other Projects
Personal GitHub profile README with Elixir/AI projects and LLM reliability research
View on GitHub →Elixir port feasibility analysis and cookbook for Tinker ML training platform
View on GitHub →Tech Stack
Specialties
- Distributed systems & fault tolerance
- AI/LLM infrastructure & reliability
- Functional programming & metaprogramming
- Statistical analysis & experimental design
- Developer tools & productivity