Feneri is the multimodal foundation model for human signal: real-time emotion, attention, and intent from video, voice, and text. The substrate beneath every agent, robot, game, and clinical product that needs to read the room.
AI keeps getting smarter. It is still emotionally blind.
Agents do not notice frustration. NPCs do not react to a player's mood. Robots do not sense when a human is uncomfortable. Voice assistants cannot tell distress from sarcasm. Feneri is the layer that fixes this. One model, one API, every builder.
We started Feneri because every AI breakthrough of the last five years has made machines smarter, not more attentive. The next class of systems (agents, robots, clinical companions) will fail the same way today's models do, until they can sense the person on the other side of the glass. That's the model we're building.
§ 02 · The engine
Emotion. Attention. Intent. One signal that finally agrees with the body.
The Feneri MMLM fuses facial micro-expressions, vocal biomarkers, and linguistic sentiment into a single multimodal signal, richer than any one input, deployed sub-second, bilingual Arabic-English from day one. Trained on 4.2 billion frames, owned end-to-end. No wrappers, no third-party models.
The architecture, in plain view.
Three input streams enter a 12-head multimodal fusion core. A single state object falls out the other end: emotion, attention, intent, every 33 milliseconds, every modality, every region.
1 Inputs
Vision30fps · facial micro-expression
Voice16kHz · vocal biomarkers
Language42 langs · 7 Arabic dialects
2 Fusion
Emotion Engine
12-head · 7B params · Rust core
3 Outputs
emotion0.78
attention0.64
intent0.71
valence+0.61
arousal0.55
stress0.28
distress0.18
§ 03 · Tools
Four doors. One engine behind them all.
However your team builds (direct API calls, native SDKs, MCP for the agent stack, or a no-code session in Studio), the same engine answers, and the same signal comes back.
Native SDKs across every surface you ship on. And when something matters, Feneri calls you back: outbound webhooks for state transitions, not endless polling.
⌘feneri-agents
For LLM agents and copilots. TypeScript & Python. Streaming context for any orchestrator: LangChain, LlamaIndex, custom.
ai & agents
◑feneri-ros
For embodied systems. ROS 2 nodes, edge-quantized models, on-device inference for humanoids and service robotics.
robotics
▲feneri-game
Plugins for Unity and Unreal. C# & Blueprint bindings. Frame-aligned emotion for NPC behavior trees and adaptive difficulty.
CCaaS- and CRM-ready. Live agent assist, supervisor alerts, sentiment-driven routing. WebRTC & SIP-bridge.
customer ops
◇feneri-edge
Swift, Kotlin, WebAssembly. System-level emotion for OS vendors and device makers. On-device, zero-network mode.
tech & os
Outbound · webhooks
And Feneri calls you back.
Subscribe to state-transition events and Feneri posts to your endpoint the moment something matters: stress crosses a threshold, attention drops, distress baseline shifts. Build alerting, escalation, or context-injection without polling.
Threshold triggers · any signal · any direction
Signed payloads · HMAC-SHA256 · replay protection
Retries with exponential backoff · dead-letter queue
For every system that needs to understand a human.
Six product surfaces. One emotional substrate. Embed the engine in an agent's planner, a robot's behavior tree, a game's session loop, or call the API once per session and route the state wherever you need it.
01 / AI & agents
Agents that know when they're losing you.
Give LLM agents real-time affective context. Adjust pacing, detail, and tone the moment a user disengages, or escalate to a human before they churn.
llm.context∿
02 / Robotics
Machines that read the room.
Humanoids and service robots that respond to people, not commands. Edge-ready inference for ROS 2.
edge.embedded◐
03 / Gaming
NPCs that respond to your face.
Dynamic difficulty, emotion-aware dialogue, frustration detection. SDKs for Unity and Unreal.
sdk.unity / unreal▲
04 / Telehealth
Clinical signal, at session scale.
HIPAA-ready affective biomarkers for telepsychiatry, CBT outcome tracking, and early-warning intervention.
hipaa.ready+
05 / Customer ops
Truth layer for every live call.
Detect frustration before churn signals appear in your CRM. Trigger live coaching for the agents who need it.
crm.realtime●
06 / Tech & OS
An attentive layer in every device.
Wearables, in-car, edge sensors. Ambient affective intelligence as a system service, on-device.
edge.sdk◇
§ 06 · Privacy by architecture
Forgotten in
60s
All raw video and audio is permanently deleted within sixty seconds of inference. Only anonymized state metadata persists. We never own, and can never leak, your users' faces or voices.
§ 07 · The numbers
Engineered for the next class of production systems.
PDPL · GDPRHIPAA-ready · KSA data residency native
§ 08 · The endpoint
One call. Any modality.
The /v1/read endpoint accepts video, audio, or text, alone or fused, and returns a structured state object you can route into anything: a game loop, a clinical workflow, a robot's planner, an agent's context.
// stream multimodal state from a live sessionimport { Feneri } from"@feneri/sdk";
const engine = newFeneri({ region: "me-jed-1" });
for await (const state of engine.read({
video: cameraStream,
audio: micStream,
text: transcript,
modes: ["emotion", "attention", "intent"],
})) {
agent.adjustPacing(state.attention);
}
# stream multimodal state from a live sessionfrom feneri import Feneri
engine = Feneri(region="me-jed-1")
async for state in engine.read(
video=camera_stream,
audio=mic_stream,
modes=["emotion", "attention", "intent"],
):
agent.adjust_pacing(state.attention)
// stream multimodal state from a live sessionuse feneri::Feneri;
let engine = Feneri::new("me-jed-1");
let mut stream = engine.read(inputs).await?;
while let Some(state) = stream.next().await {
agent.adjust_pacing(state.attention);
}
For two centuries they kept ships from running aground in fog they could not see through.
Feneri does the same for machines: a steady beacon of human signal, so the next generation of systems can finally tell the difference between someone who is fine and someone who is drowning.
Feneri Manifesto·Volume I · 2026
Get in touch
Build with the engine.
Engine access is currently invitation-only. Tell us what you're building. We read every application within 48 hours.