North Shore Hackerspace

Cultivating tomorrow's intelligent systems with island wisdom and BEAM excellence. Open-source AI/ML tools, security architecture, and blockchain innovation.

119
Repositories
430
Stars
17
Categories
<100ms
p99 Latency

Ingot Data Labeling

forge
2

Sample factory library for generating, transforming, and computing measurements on samples

View on GitHub →
anvil
1

Labeling queue library for managing human labeling workflows

View on GitHub →
ingot
1

Phoenix LiveView interface for sample generation and human labeling workflows

View on GitHub →
labeling_ir
1

Shared IR structs for the North Shore labeling stack (Forge/Anvil/Ingot) — typed datasets, samples, assignments, labels, artifacts, and evaluation runs for labeling workflows

View on GitHub →

AI Agent Orchestration

synapse
40

Headless, declarative multi-agent orchestration framework with a domain-agnostic signal bus, workflow engine with Postgres persistence, and configurable agent runtime (ships code review domain).

View on GitHub →
flowstone
25

Asset-first data orchestration for Elixir/BEAM. Dagster-inspired with OTP fault tolerance, LiveView dashboard, lineage tracking, checkpoint gates, and distributed execution via Oban.

View on GitHub →
ds_ex
16

DSPEx - Declarative Self-improving Elixir | A BEAM-Native AI Program Optimization Framework

View on GitHub →
DSPex
14

Declarative Self Improving Elixir - DSPy Orchestration in Elixir

View on GitHub →
pipeline_ex
8

Claude Code + Gemini AI collaboration orchestration tools

View on GitHub →
ALTAR
7

The Agent & Tool Arbitration Protocol

View on GitHub →
mabeam
6

Multi-agent systems framework for the BEAM platform - build distributed autonomous agents with OTP supervision and fault tolerance

View on GitHub →
flowstone_ai
1

FlowStone integration for altar_ai - AI-powered data pipeline assets with classify_each, enrich_each, embed_each helpers and unified telemetry

View on GitHub →
synapse_ai
1

Synapse integration for altar_ai - SDK-backed LLM providers for multi-agent workflows with automatic fallback, signal handlers, and workflow actions

View on GitHub →

AI SDKs & API Clients

gemini_ex
28

Elixir Interface / Adapter for Google Gemini LLM, for both AI Studio and Vertex AI

View on GitHub →
claude_agent_sdk
26

An Elixir SDK for Claude Code - provides programmatic access to Claude Code CLI with streaming message processing

View on GitHub →
codex_sdk
13

OpenAI Codex SDK written in Elixir

View on GitHub →
agent_session_manager
5

Agent Session Manager - A comprehensive Elixir library for managing AI agent sessions, state persistence, conversation context, and multi-agent orchestration workflows

View on GitHub →
altar_ai
3

Protocol-based AI adapter foundation for Elixir - unified abstractions for gemini_ex, claude_agent_sdk, codex_sdk with automatic fallback, capability detection, and telemetry

View on GitHub →
ollixir
3

Ollixir provides a first-class Elixir client with feature parity to the official ollama-python library. Ollixir runs large language models locally or on your infrastructure via Ollama.

View on GitHub →
jules_ex
2

Elixir client SDK for the Jules API - orchestrate AI coding sessions

View on GitHub →
mcp_client
1

Full-featured Elixir client for the Model Context Protocol (MCP) with multi-transport support, resources, prompts, tools, and telemetry.

View on GitHub →
amp_sdk

Elixir SDK for the Amp CLI — provides a comprehensive client library for interacting with Amp's AI-powered coding agent, including thread management, tool orchestration, streaming responses, and programmatic access to Amp's full feature set from Elixir/OTP applications

View on GitHub →
crucible_prompts

Prompt and parsing utilities for Crucible and NSAI. Provides templating, schema validation, structured output parsing, and tool-call helpers for consistent LLM IO.

View on GitHub →
gemini_cli_sdk

An Elixir SDK for the Gemini CLI — Build AI-powered applications with Google Gemini via a robust, idiomatic wrapper around the Gemini CLI. Features streaming, structured output, session management, model selection, and OTP supervision tree integration for production-grade Gemini-powered Elixir apps.

View on GitHub →
notion_sdk

Native Elixir SDK for the Notion API — comprehensive, idiomatic client for Notion workspaces, databases, pages, blocks, users, comments, and search. Built on OTP with supervised HTTP, automatic rate limiting, pagination helpers, and robust error handling for BEAM applications.

View on GitHub →
nsai_llm

Shared LLM Actions for NSAI runtimes. Wraps PortfolioCore adapters with Jido.Action semantics and CrucibleIR.Backend input/output to centralize provider access.

View on GitHub →
vllm

vLLM - High-throughput, memory-efficient LLM inference engine with PagedAttention, continuous batching, CUDA/HIP optimization, quantization (GPTQ/AWQ/INT4/INT8/FP8), tensor/pipeline parallelism, OpenAI-compatible API, multi-GPU/TPU/Neuron support, prefix caching, and multi-LoRA capabilities

View on GitHub →

AI Infrastructure

json_remedy
27

A practical, multi-layered JSON repair library for Elixir that intelligently fixes malformed JSON strings commonly produced by LLMs, legacy systems, and data pipelines.

View on GitHub →
snakepit
10

High-performance, generalized process pooler and session manager for external language integrations. Orchestrates and supervises languages like Python and Javascript from Elixir.

View on GitHub →
rag_ex
6

Elixir RAG library with multi-LLM routing (Gemini, Claude, OpenAI, Ollama), GraphRAG, knowledge graphs, modular retrievers/rerankers, composable pipelines, pgvector integration, advanced chunking, and tool-using agents. Fork of bitcrowd/rag.

View on GitHub →
snakebridge
4

Compile-time Elixir code generator for Python library bindings. Declare dependencies in mix.exs, generate type-safe modules with introspected typespecs and docs. Deterministic git-friendly output, strict CI mode, streaming, and custom helpers. Runtime via Snakepit.

View on GitHub →
tinkex_cookbook
3

Elixir port of tinker-cookbook: training and evaluation recipes for the Tinker ML platform.

View on GitHub →
tinkex
2

Elixir SDK for the Tinker ML platform—LoRA training, sampling, and service orchestration built on OTP, Finch, and telemetry.

View on GitHub →
command
1

Core Elixir library for AI agent orchestration - unified workbench for running, tracking, and orchestrating multi-provider LLM agents with sessions, workflows, RAG indexes, tool approvals, and cost tracking

View on GitHub →
gepa_ex
1

Elixir implementation of GEPA: LLM-driven evolutionary optimization using Pareto-efficient search for text-based systems. Features OpenAI/Gemini integration, BEAM concurrency, OTP supervision, 218 tests with 75% coverage.

View on GitHub →
nsai_gateway
1

Unified API gateway for the NSAI ecosystem—authentication (JWT, API keys, OAuth2/OIDC), distributed rate limiting with burst allowance, circuit breakers, request tracing, Prometheus metrics, and service proxying. Production-ready with comprehensive observability and multi-tenant support.

View on GitHub →
nsai_registry
1

Service discovery and registry for the NSAI ecosystem—distributed registry with health checking, circuit breakers, multiple storage backends (ETS/PostgreSQL), PubSub event broadcasting, and comprehensive telemetry. Built on OTP with Horde-ready architecture for multi-node deployments.

View on GitHub →
nsai_work
1

NSAI.Work - Unified job scheduler for North-Shore-AI platform

View on GitHub →
pilot
1

Interactive CLI and REPL for the NSAI ecosystem—unified interface to registry, gateway, jobs, experiments, datasets, embeddings, and metrics services; tab completion with bash/zsh scripts; configurable environments; JSON output mode for scripting; escript distribution. The cockpit for North Shore AI operations.

View on GitHub →
portfolio_core
1

Hexagonal architecture core for Elixir RAG systems. Port specifications, manifest-based config, adapter registry, and DI framework. Enables swappable vector/graph/embedding/LLM backends via clean port/adapter abstractions. Hex.pm publishable.

View on GitHub →
skill_ex
1

Claude Skill Aggregator

View on GitHub →
slither
1

Lightweight Elixir runtime for composing and executing Python-backed data pipelines with automatic dependency resolution, lazy evaluation, fault-tolerant stage supervision, and seamless Snakebridge/Snakepit integration for production-grade cross-language AI and scientific computing workflows on the BEAM.

View on GitHub →
tiktoken_ex
1

Pure Elixir TikToken-style byte-level BPE tokenizer (Kimi K2 compatible).

View on GitHub →
tinkerer
1

Chiral Narrative Synthesis workspace for Thinker/Tinker LoRA pipelines, semantic fact-checking, telemetry, and reviewer-ready CNS docs.

View on GitHub →
hf_hub_ex

Elixir client for HuggingFace Hub—dataset/model metadata, file downloads, caching, and authentication. The BEAM-native foundation for HF ecosystem ports.

View on GitHub →
hf_peft_ex

Elixir port of HuggingFace's PEFT (Parameter-Efficient Fine-Tuning) library. Implements LoRA, AdaLoRA, IA3, prefix tuning, prompt tuning, and 30+ state-of-the-art PEFT methods for efficient neural network adaptation. Built for the BEAM ecosystem with native Nx/Axon integration.

View on GitHub →
portfolio_index

Production adapters and pipelines for PortfolioCore. Vector stores (pgvector, Qdrant), graph stores (Neo4j), embedders (OpenAI), Broadway pipelines, advanced RAG (Self-RAG, CRAG, GraphRAG, Agentic), multi-graph federation, and observability.

View on GitHub →
portfolio_manager

AI-native personal project intelligence system - manage, track, and search across all your repositories with semantic understanding

View on GitHub →

Schema & Validation

exdantic
11

A powerful, flexible schema definition and validation library for Elixir, inspired by Python's Pydantic.

View on GitHub →
sinter
10

Unified schema definition, validation, and JSON generation for Elixir

View on GitHub →
perimeter
7

Advanced typing and type validation mechanism for Elixir - runtime type checking and contract enforcement for BEAM applications

View on GitHub →
batch_ir

Batch IR for standardized data interchange across training and inference backends. Covers text/token/chat/instruct batch types with encoding, validation, and portable schemas.

View on GitHub →

Developer Tools

ex_dbg
10

State-of-the-Art Introspection and Debugging System for Elixir/Phoenix Applications

View on GitHub →
ElixirScope
5

AI-Powered Execution Cinema Debugger for Elixir/BEAM

View on GitHub →
elixir_scope
5

Revolutionary AST-based debugging and code intelligence platform for Elixir applications

View on GitHub →
elixir_dashboard
2

A Phoenix LiveView performance monitoring dashboard for tracking slow endpoints and database queries

View on GitHub →
elixir_tracer
1

Local-first observability for Elixir with New Relic API parity

View on GitHub →
portfolio_coder

Code Intelligence Platform: Repository analysis, semantic code search, dependency graphs, and AI-powered code understanding built on the Portfolio RAG ecosystem. Features multi-language parsing (Elixir, Python, JavaScript, TypeScript), AST-aware chunking, call graph analysis, and intelligent code agents for review, refactoring, and documentation.

View on GitHub →
pristine

Manifest-driven hexagonal core for generating Elixir SDKs and services with pluggable ports/adapters for transport, schema, retries, telemetry, streaming, and multipart.

View on GitHub →
prompt_runner_sdk

Prompt Runner SDK - Elixir toolkit for orchestrating multi-step prompt executions with Claude Code SDK and Codex SDK. Streaming output, progress tracking, multi-repo commits, configurable LLM backends with per-prompt overrides, and automatic git integration.

View on GitHub →

OTP & Distributed

superlearner
8

OTP Supervisor Educational Platform

View on GitHub →
apex
4

Core Apex framework for OTP supervision and monitoring

View on GitHub →
apex_ui
4

Web UI for Apex OTP supervision and monitoring tools

View on GitHub →
arsenal
4

Metaprogramming framework for automatic REST API generation from OTP operations

View on GitHub →
arsenal_plug
3

Phoenix/Plug adapter for Apex Arsenal framework

View on GitHub →

Testing & QA

supertester
13

A battle-hardened testing toolkit for building robust and resilient Elixir & OTP applications.

View on GitHub →
playwriter
6

Elixir WSL-to-Windows browser integration

View on GitHub →
cluster_test
4

Distributed Erlang/Elixir test cluster management via Mix tasks

View on GitHub →
sandbox
4

Isolated OTP application management system for Elixir/Erlang

View on GitHub →

Observability

foundation
11

Elixir infrastructure and Observability Library

View on GitHub →
AITrace
1

The unified observability layer for the AI Control Plane

View on GitHub →
Citadel
1

The command and control layer for the AI-powered enterprise

View on GitHub →
lineage_ir

Lineage IR for cross-system traces, spans, artifacts, and provenance edges. Provides a shared event envelope and sink interface for consolidation across runtimes.

View on GitHub →
telemetry_reporter

Pachka-powered telemetry reporter for Elixir that batches client-side events, supports pluggable transports and :telemetry forwarding, and drains reliably on shutdown.

View on GitHub →

Data & Databases

duckdb_ex
1

DuckDB driver client in Elixir

View on GitHub →
embed_ex
1

Vector embeddings service for Elixir—multi-provider support (OpenAI, Cohere, Voyage AI), intelligent caching with Cachex, batch processing with rate limiting, Nx-powered similarity computations, k-means/DBSCAN clustering, semantic deduplication, and ETS-based vector storage. Built for CNS and ML pipelines.

View on GitHub →
weaviate_ex
1

Modern Elixir client for Weaviate vector database with health checks and friendly error messages

View on GitHub →
ex_topology

Pure Elixir library for graph topology, TDA, and computational topology

View on GitHub →
nx_penalties

Composable regularization penalties for Elixir Nx. L1/L2/Elastic Net, KL divergence, entropy, consistency, gradient penalty, orthogonality. Pure Nx.Defn for JIT across EXLA/Torchx. Pipeline composition and Axon.Loop integration.

View on GitHub →

Security

GUARDRAIL
17

GUARDRAIL - MCP Security - Gateway for Unified Access, Resource Delegation, and Risk-Attenuating Information Limits

View on GitHub →
ASKA
8

Secure Computing in the AI age

View on GitHub →
pqc-hqc
6

Post-quantum cryptographic implementation of HQC (Hamming Quasi-Cyclic) - a NIST PQC candidate for quantum-resistant key encapsulation using code-based cryptography

View on GitHub →
Shield

SHIELD: Secure Hierarchical Inter-agent Layer for Distributed Environments

View on GitHub →

Research

ChronoLedger
2

Hardware-Secured Temporal Blockchain

View on GitHub →
cns
1

Chiral Narrative Synthesis - Dialectical reasoning framework for automated knowledge discovery

View on GitHub →
EADS

Evolutionary Autonomous Development System

View on GitHub →
cns_ui

Phoenix LiveView interface for CNS dialectical reasoning experiments

View on GitHub →

Utilities

youtube_audio_dl
2

Download high-quality audio from YouTube as MP3 files using Elixir. Features 104 music genres, duration filtering, per-genre caching, C++ DSP filters, and ML-based transient detection.

View on GitHub →
tools
1

Utility library and helper functions for Elixir development - common patterns, debugging aids, and productivity tools

View on GitHub →
chz_ex

Elixir port of OpenAI's chz library - a powerful configuration management system for building composable, type-safe command-line interfaces with hierarchical configuration, environment variable support, and flexible argument parsing

View on GitHub →
multipart_ex

Client-agnostic multipart/form-data builder for Elixir with explicit file inputs, stream-first encoding, configurable form serialization, and adapters for common HTTP clients.

View on GitHub →

Crucible Framework

A platform for conducting reproducible experiments on large language model reliability, built on Elixir/OTP.

Elixir OTP BEAM VM Statistical Testing Ensemble Methods
LlmGuard
7

AI Firewall and guardrails for LLM-based Elixir applications

View on GitHub →
ExFairness
1

Fairness and bias detection library for Elixir AI/ML systems

View on GitHub →
crucible_examples
1

Interactive Phoenix LiveView demonstrations of the Crucible Framework - showcasing ensemble voting, request hedging, statistical analysis, and more with mock LLMs

View on GitHub →
ExDataCheck

Data validation and quality library for ML pipelines in Elixir

View on GitHub →
cns_crucible

View on GitHub →
crucible_adversary

Adversarial testing and robustness evaluation for the Crucible framework

View on GitHub →
crucible_bench

Statistical testing and analysis framework for AI research

View on GitHub →
crucible_datasets

Dataset management and caching for AI research benchmarks

View on GitHub →
crucible_deployment

ML model deployment for the Crucible ecosystem. vLLM and Ollama integration, canary deployments, A/B testing, traffic routing, health checks, rollback strategies, and inference serving for Elixir-based ML workflows.

View on GitHub →
crucible_ensemble

Multi-model ensemble voting strategies for LLM reliability

View on GitHub →
crucible_feedback

ML feedback loop management for the Crucible ecosystem. Quality monitoring, data drift detection, model performance tracking, data curation, active learning, human-in-the-loop workflows, and continuous improvement for Elixir-based ML.

View on GitHub →
crucible_framework

CrucibleFramework: A scientific platform for LLM reliability research on the BEAM

View on GitHub →
crucible_harness

Experimental research framework for running AI benchmarks at scale

View on GitHub →
crucible_hedging

Request hedging for tail latency reduction in distributed systems

View on GitHub →
crucible_ir

Intermediate Representation for the Crucible ML reliability ecosystem

View on GitHub →
crucible_kitchen

Industrial ML training orchestration - backend-agnostic workflow engine for supervised, reinforcement, and preference learning. Provides composable workflows, declarative stage DSL, comprehensive telemetry, and port/adapter patterns for any ML backend. The missing orchestration layer that makes ML cookbooks trivially thin.

View on GitHub →
crucible_model_registry

ML model registry for the Crucible ecosystem. Artifact storage, model versioning, lineage tracking, metadata management, model comparison, reproducibility, and integration with training pipelines for Elixir-based ML workflows.

View on GitHub →
crucible_telemetry

Advanced telemetry collection and analysis for AI research

View on GitHub →
crucible_trace

Structured causal reasoning chain logging for LLM transparency

View on GitHub →
crucible_train

ML training orchestration for the Crucible ecosystem. Distributed training, hyperparameter optimization, checkpointing, model versioning, metrics collection, early stopping, LR scheduling, gradient accumulation, and mixed precision training with Nx/Scholar integration.

View on GitHub →
crucible_ui

Phoenix LiveView dashboard for the Crucible ML reliability stack

View on GitHub →
crucible_xai

Explainable AI (XAI) tools for the Crucible framework

View on GitHub →
datasets_ex

Dataset management library for ML experiments—loaders for SciFact, FEVER, GSM8K, HumanEval, MMLU, TruthfulQA, HellaSwag; git-like versioning with lineage tracking; transformation pipelines; quality validation with schema checks and duplicate detection; GenStage streaming for large datasets. Built for reproducible AI research.

View on GitHub →
eval_ex

Model evaluation harness for standardized benchmarking—comprehensive metrics (F1, BLEU, ROUGE, METEOR, BERTScore, pass@k), statistical analysis (confidence intervals, effect size, bootstrap CI, ANOVA), multi-model comparison, and report generation. Research-grade evaluation for LLM and ML experiments.

View on GitHub →
hf_datasets_ex

HuggingFace Datasets for Elixir - A native Elixir port of the popular HuggingFace datasets library. Stream, load, and process ML datasets from the HuggingFace Hub with full BEAM/OTP integration. Supports Parquet streaming, dataset splitting, shuffling, and seamless integration with Nx tensors for machine learning workflows.

View on GitHub →
metrics_ex

Metrics aggregation and alerting for ML experiments—multi-backend export (Prometheus, InfluxDB, Datadog, OpenTelemetry), advanced aggregations (percentiles, histograms, moving averages), threshold-based alerting with anomaly detection (z-score, IQR), and time-series storage. Research-grade observability for the NSAI ecosystem.

View on GitHub →
training_ir

Training IR for reproducible ML jobs across Crucible and Kitchen. Defines model specs, adapters, learning config, checkpointing, validation, and resource envelopes to standardize training pipelines.

View on GitHub →

Other Projects

nshkrdotcom

Personal GitHub profile README with Elixir/AI projects and LLM reliability research

View on GitHub →