North Shore Hackerspace

anvil

1

Labeling queue library for managing human labeling workflows

forge

1

Sample factory library for generating, transforming, and computing measurements on samples

ingot

1

Phoenix LiveView interface for sample generation and human labeling workflows

labeling_ir

1

Shared IR structs for the North Shore labeling stack (Forge/Anvil/Ingot) — typed datasets, samples, assignments, labels, artifacts, and evaluation runs for labeling workflows

synapse

37

Headless, declarative multi-agent orchestration framework with a domain-agnostic signal bus, workflow engine with Postgres persistence, and configurable agent runtime (ships code review domain).

DSPEx - Declarative Self-improving Elixir | A BEAM-Native AI Program Optimization Framework

flowstone

15

Asset-first data orchestration for Elixir/BEAM. Dagster-inspired with OTP fault tolerance, LiveView dashboard, lineage tracking, checkpoint gates, and distributed execution via Oban.

DSPex

13

Declarative Self Improving Elixir - DSPy Orchestration in Elixir

pipeline_ex

8

Claude Code + Gemini AI collaboration orchestration tools

ALTAR

7

The Agent & Tool Arbitration Protocol

Multi-agent systems framework for the BEAM platform - build distributed autonomous agents with OTP supervision and fault tolerance

flowstone_ai

1

FlowStone integration for altar_ai - AI-powered data pipeline assets with classify_each, enrich_each, embed_each helpers and unified telemetry

synapse_ai

1

Synapse integration for altar_ai - SDK-backed LLM providers for multi-agent workflows with automatic fallback, signal handlers, and workflow actions

gemini_ex

25

Elixir Interface / Adapter for Google Gemini LLM, for both AI Studio and Vertex AI

claude_agent_sdk

22

An Elixir SDK for Claude Code - provides programmatic access to Claude Code CLI with streaming message processing

codex_sdk

9

OpenAI Codex SDK written in Elixir

altar_ai

2

Protocol-based AI adapter foundation for Elixir - unified abstractions for gemini_ex, claude_agent_sdk, codex_sdk with automatic fallback, capability detection, and telemetry

jules_ex

2

Elixir client SDK for the Jules API - orchestrate AI coding sessions

ollixir

2

Ollixir provides a first-class Elixir client with feature parity to the official ollama-python library. Ollixir runs large language models locally or on your infrastructure via Ollama.

mcp_client

1

Full-featured Elixir client for the Model Context Protocol (MCP) with multi-transport support, resources, prompts, tools, and telemetry.

agent_session_manager

Agent Session Manager - A comprehensive Elixir library for managing AI agent sessions, state persistence, conversation context, and multi-agent orchestration workflows

Prompt and parsing utilities for Crucible and NSAI. Provides templating, schema validation, structured output parsing, and tool-call helpers for consistent LLM IO.

Shared LLM Actions for NSAI runtimes. Wraps PortfolioCore adapters with Jido.Action semantics and CrucibleIR.Backend input/output to centralize provider access.

vLLM - High-throughput, memory-efficient LLM inference engine with PagedAttention, continuous batching, CUDA/HIP optimization, quantization (GPTQ/AWQ/INT4/INT8/FP8), tensor/pipeline parallelism, OpenAI-compatible API, multi-GPU/TPU/Neuron support, prefix caching, and multi-LoRA capabilities

json_remedy

25

A practical, multi-layered JSON repair library for Elixir that intelligently fixes malformed JSON strings commonly produced by LLMs, legacy systems, and data pipelines.

snakepit

10

High-performance, generalized process pooler and session manager for external language integrations. Orchestrates and supervises languages like Python and Javascript from Elixir.

rag_ex

4

Elixir RAG library with multi-LLM routing (Gemini, Claude, OpenAI, Ollama), GraphRAG, knowledge graphs, modular retrievers/rerankers, composable pipelines, pgvector integration, advanced chunking, and tool-using agents. Fork of bitcrowd/rag.

snakebridge

4

Compile-time Elixir code generator for Python library bindings. Declare dependencies in mix.exs, generate type-safe modules with introspected typespecs and docs. Deterministic git-friendly output, strict CI mode, streaming, and custom helpers. Runtime via Snakepit.

tinkex

2

Elixir SDK for the Tinker ML platform—LoRA training, sampling, and service orchestration built on OTP, Finch, and telemetry.

Core Elixir library for AI agent orchestration - unified workbench for running, tracking, and orchestrating multi-provider LLM agents with sessions, workflows, RAG indexes, tool approvals, and cost tracking

gepa_ex

1

Elixir implementation of GEPA: LLM-driven evolutionary optimization using Pareto-efficient search for text-based systems. Features OpenAI/Gemini integration, BEAM concurrency, OTP supervision, 218 tests with 75% coverage.

nsai_gateway

1

Unified API gateway for the NSAI ecosystem—authentication (JWT, API keys, OAuth2/OIDC), distributed rate limiting with burst allowance, circuit breakers, request tracing, Prometheus metrics, and service proxying. Production-ready with comprehensive observability and multi-tenant support.

nsai_registry

1

Service discovery and registry for the NSAI ecosystem—distributed registry with health checking, circuit breakers, multiple storage backends (ETS/PostgreSQL), PubSub event broadcasting, and comprehensive telemetry. Built on OTP with Horde-ready architecture for multi-node deployments.

NSAI.Work - Unified job scheduler for North-Shore-AI platform

pilot

1

Interactive CLI and REPL for the NSAI ecosystem—unified interface to registry, gateway, jobs, experiments, datasets, embeddings, and metrics services; tab completion with bash/zsh scripts; configurable environments; JSON output mode for scripting; escript distribution. The cockpit for North Shore AI operations.

portfolio_core

1

Hexagonal architecture core for Elixir RAG systems. Port specifications, manifest-based config, adapter registry, and DI framework. Enables swappable vector/graph/embedding/LLM backends via clean port/adapter abstractions. Hex.pm publishable.

skill_ex

1

Claude Skill Aggregator

tiktoken_ex

1

Pure Elixir TikToken-style byte-level BPE tokenizer (Kimi K2 compatible).

tinkerer

1

Chiral Narrative Synthesis workspace for Thinker/Tinker LoRA pipelines, semantic fact-checking, telemetry, and reviewer-ready CNS docs.

tinkex_cookbook

1

Elixir port of tinker-cookbook: training and evaluation recipes for the Tinker ML platform.

hf_hub_ex

Elixir client for HuggingFace Hub—dataset/model metadata, file downloads, caching, and authentication. The BEAM-native foundation for HF ecosystem ports.

hf_peft_ex

Elixir port of HuggingFace's PEFT (Parameter-Efficient Fine-Tuning) library. Implements LoRA, AdaLoRA, IA3, prefix tuning, prompt tuning, and 30+ state-of-the-art PEFT methods for efficient neural network adaptation. Built for the BEAM ecosystem with native Nx/Axon integration.

portfolio_index

Production adapters and pipelines for PortfolioCore. Vector stores (pgvector, Qdrant), graph stores (Neo4j), embedders (OpenAI), Broadway pipelines, advanced RAG (Self-RAG, CRAG, GraphRAG, Agentic), multi-graph federation, and observability.

portfolio_manager

AI-native personal project intelligence system - manage, track, and search across all your repositories with semantic understanding

A powerful, flexible schema definition and validation library for Elixir, inspired by Python's Pydantic.

sinter

10

Unified schema definition, validation, and JSON generation for Elixir

Advanced typing and type validation mechanism for Elixir - runtime type checking and contract enforcement for BEAM applications

Batch IR for standardized data interchange across training and inference backends. Covers text/token/chat/instruct batch types with encoding, validation, and portable schemas.

State-of-the-Art Introspection and Debugging System for Elixir/Phoenix Applications

AI-Powered Execution Cinema Debugger for Elixir/BEAM

Revolutionary AST-based debugging and code intelligence platform for Elixir applications

elixir_dashboard

2

A Phoenix LiveView performance monitoring dashboard for tracking slow endpoints and database queries

elixir_tracer

1

Local-first observability for Elixir with New Relic API parity

portfolio_coder

Code Intelligence Platform: Repository analysis, semantic code search, dependency graphs, and AI-powered code understanding built on the Portfolio RAG ecosystem. Features multi-language parsing (Elixir, Python, JavaScript, TypeScript), AST-aware chunking, call graph analysis, and intelligent code agents for review, refactoring, and documentation.

pristine

Manifest-driven hexagonal core for generating Elixir SDKs and services with pluggable ports/adapters for transport, schema, retries, telemetry, streaming, and multipart.

prompt_runner_sdk

Prompt Runner SDK - Elixir toolkit for orchestrating multi-step prompt executions with Claude Code SDK and Codex SDK. Streaming output, progress tracking, multi-repo commits, configurable LLM backends with per-prompt overrides, and automatic git integration.

OTP Supervisor Educational Platform

Core Apex framework for OTP supervision and monitoring

Web UI for Apex OTP supervision and monitoring tools

arsenal

4

Metaprogramming framework for automatic REST API generation from OTP operations

Phoenix/Plug adapter for Apex Arsenal framework

supertester

11

A battle-hardened testing toolkit for building robust and resilient Elixir & OTP applications.

Elixir WSL-to-Windows browser integration

Distributed Erlang/Elixir test cluster management via Mix tasks

sandbox

4

Isolated OTP application management system for Elixir/Erlang

foundation

11

Elixir infrastructure and Observability Library

AITrace

1

The unified observability layer for the AI Control Plane

The command and control layer for the AI-powered enterprise

lineage_ir

Lineage IR for cross-system traces, spans, artifacts, and provenance edges. Provides a shared event envelope and sink interface for consolidation across runtimes.

telemetry_reporter

Pachka-powered telemetry reporter for Elixir that batches client-side events, supports pluggable transports and :telemetry forwarding, and drains reliably on shutdown.

duckdb_ex

1

DuckDB driver client in Elixir

embed_ex

1

Vector embeddings service for Elixir—multi-provider support (OpenAI, Cohere, Voyage AI), intelligent caching with Cachex, batch processing with rate limiting, Nx-powered similarity computations, k-means/DBSCAN clustering, semantic deduplication, and ETS-based vector storage. Built for CNS and ML pipelines.

weaviate_ex

1

Modern Elixir client for Weaviate vector database with health checks and friendly error messages

ex_topology

Pure Elixir library for graph topology, TDA, and computational topology

nx_penalties

Composable regularization penalties for Elixir Nx. L1/L2/Elastic Net, KL divergence, entropy, consistency, gradient penalty, orthogonality. Pure Nx.Defn for JIT across EXLA/Torchx. Pipeline composition and Axon.Loop integration.

GUARDRAIL - MCP Security - Gateway for Unified Access, Resource Delegation, and Risk-Attenuating Information Limits

Secure Computing in the AI age

Post-quantum cryptographic implementation of HQC (Hamming Quasi-Cyclic) - a NIST PQC candidate for quantum-resistant key encapsulation using code-based cryptography

SHIELD: Secure Hierarchical Inter-agent Layer for Distributed Environments

Hardware-Secured Temporal Blockchain

cns

1

Chiral Narrative Synthesis - Dialectical reasoning framework for automated knowledge discovery

Evolutionary Autonomous Development System

cns_ui

Phoenix LiveView interface for CNS dialectical reasoning experiments

youtube_audio_dl

2

Download high-quality audio from YouTube as MP3 files using Elixir. Features 104 music genres, duration filtering, per-genre caching, C++ DSP filters, and ML-based transient detection.

Utility library and helper functions for Elixir development - common patterns, debugging aids, and productivity tools

chz_ex

Elixir port of OpenAI's chz library - a powerful configuration management system for building composable, type-safe command-line interfaces with hierarchical configuration, environment variable support, and flexible argument parsing

multipart_ex

Client-agnostic multipart/form-data builder for Elixir with explicit file inputs, stream-first encoding, configurable form serialization, and adapters for common HTTP clients.

LlmGuard

5

AI Firewall and guardrails for LLM-based Elixir applications

Interactive Phoenix LiveView demonstrations of the Crucible Framework - showcasing ensemble voting, request hedging, statistical analysis, and more with mock LLMs

ExDataCheck

Data validation and quality library for ML pipelines in Elixir

ExFairness

Fairness and bias detection library for Elixir AI/ML systems

crucible_adversary

Adversarial testing and robustness evaluation for the Crucible framework

crucible_bench

Statistical testing and analysis framework for AI research

crucible_datasets

Dataset management and caching for AI research benchmarks

crucible_deployment

ML model deployment for the Crucible ecosystem. vLLM and Ollama integration, canary deployments, A/B testing, traffic routing, health checks, rollback strategies, and inference serving for Elixir-based ML workflows.

crucible_ensemble

Multi-model ensemble voting strategies for LLM reliability

crucible_feedback

ML feedback loop management for the Crucible ecosystem. Quality monitoring, data drift detection, model performance tracking, data curation, active learning, human-in-the-loop workflows, and continuous improvement for Elixir-based ML.

crucible_framework

CrucibleFramework: A scientific platform for LLM reliability research on the BEAM

crucible_harness

Experimental research framework for running AI benchmarks at scale

crucible_hedging

Request hedging for tail latency reduction in distributed systems

crucible_ir

Intermediate Representation for the Crucible ML reliability ecosystem

crucible_kitchen

Industrial ML training orchestration - backend-agnostic workflow engine for supervised, reinforcement, and preference learning. Provides composable workflows, declarative stage DSL, comprehensive telemetry, and port/adapter patterns for any ML backend. The missing orchestration layer that makes ML cookbooks trivially thin.

crucible_model_registry

ML model registry for the Crucible ecosystem. Artifact storage, model versioning, lineage tracking, metadata management, model comparison, reproducibility, and integration with training pipelines for Elixir-based ML workflows.

crucible_telemetry

Advanced telemetry collection and analysis for AI research

crucible_trace

Structured causal reasoning chain logging for LLM transparency

crucible_train

ML training orchestration for the Crucible ecosystem. Distributed training, hyperparameter optimization, checkpointing, model versioning, metrics collection, early stopping, LR scheduling, gradient accumulation, and mixed precision training with Nx/Scholar integration.

crucible_ui

Phoenix LiveView dashboard for the Crucible ML reliability stack

crucible_xai

Explainable AI (XAI) tools for the Crucible framework

datasets_ex

Dataset management library for ML experiments—loaders for SciFact, FEVER, GSM8K, HumanEval, MMLU, TruthfulQA, HellaSwag; git-like versioning with lineage tracking; transformation pipelines; quality validation with schema checks and duplicate detection; GenStage streaming for large datasets. Built for reproducible AI research.

eval_ex

Model evaluation harness for standardized benchmarking—comprehensive metrics (F1, BLEU, ROUGE, METEOR, BERTScore, pass@k), statistical analysis (confidence intervals, effect size, bootstrap CI, ANOVA), multi-model comparison, and report generation. Research-grade evaluation for LLM and ML experiments.

hf_datasets_ex

HuggingFace Datasets for Elixir - A native Elixir port of the popular HuggingFace datasets library. Stream, load, and process ML datasets from the HuggingFace Hub with full BEAM/OTP integration. Supports Parquet streaming, dataset splitting, shuffling, and seamless integration with Nx tensors for machine learning workflows.

metrics_ex

Metrics aggregation and alerting for ML experiments—multi-backend export (Prometheus, InfluxDB, Datadog, OpenTelemetry), advanced aggregations (percentiles, histograms, moving averages), threshold-based alerting with anomaly detection (z-score, IQR), and time-series storage. Research-grade observability for the NSAI ecosystem.

Training IR for reproducible ML jobs across Crucible and Kitchen. Defines model specs, adapters, learning config, checkpointing, validation, and resource envelopes to standardize training pipelines.

Personal GitHub profile README with Elixir/AI projects and LLM reliability research