Skip to main content

What is Synheart Core SDK?

Synheart Core SDK is the unified integration point for developers who want to collect multimodal signals, process human state on-device (HSV - Human State Vector), generate focus/emotion signals, integrate with Syni, upload derived state snapshots (HSI 1.0 format) to the cloud (with user consent), and visualize state dashboards.

Key Features

Unified API

  • Single SDK: One integration point for all Synheart features
  • Modular Design: Enable only the modules you need
  • Consistent Interface: Same API patterns across all platforms
  • Multi-Module Support: Wear, Phone, Behavior, HSI, Consent, Cloud, Syni

On-Device Processing

  • HSI Runtime: Produces HSV (Human State Vector) - human state fusion and inference locally
  • Privacy-First: All processing happens on-device
  • Low Latency: ≤ 100ms HSV update latency
  • Efficient: < 2% CPU, < 15MB memory, < 0.5%/hr battery

Multi-Platform Support

PlatformLanguageStatusRepository
Flutter/DartDartReadysynheart-core-sdk-dart
AndroidKotlinReadysynheart-core-sdk-kotlin
iOSSwiftReadysynheart-core-sdk-swift

Capability System

Access levels tied to app signature and tenant ID:
ModuleCoreExtendedResearch
WearDerived biosignalsHigher frequencyRaw streams
PhoneMotion, screenAdvanced app contextFull context
BehaviorBasic metricsExtended metricsEvent-level streams
HSV RuntimeBasic stateFull embeddingFull fusion vectors
ConnectorIngest (HSI 1.0)Extended endpointsResearch endpoints
By default, third-party apps run under Core capabilities. Extended and Research capabilities are enabled only for first‑party Synheart apps and approved partners, since they may unlock higher-sensitivity data access and require additional privacy/security review and contractual controls.

Module System

The Core SDK consolidates all Synheart signal channels:
Synheart Core SDK

├── Wear Module
│      (HR, HRV, sleep, motion — derived signals only)

├── Phone Module
│      (motion, screen state, coarse app context)

├── Synheart Behavior (Module)
│      (interaction patterns: taps, scrolls, typing cadence)

├── HSI Runtime (On-device)
│      - multimodal fusion
│      - produces HSV (Human State Vector)
│      - state axes & indices
│      - time windows (30s, 5m, 1h, 24h)
│      - 64D state embedding

├── Interpretation Modules (Optional)
│      ├── Synheart Emotion
│      │     (affect modeling - optional, explicit enable)
│      └── Synheart Focus
│            (engagement/focus estimation - optional, explicit enable)

├── Consent Module
│      (permissions, masking, enforcement)

├── Cloud Connector
│      (secure, consent-gated uploads)

└── Syni Hooks
       (HSI context + optional interpretations)

Quick Start

Flutter/Dart

Dart SDK Guide

Complete Flutter integration guide
Installation:
dependencies:
  synheart_core: ^1.0.0
Basic Usage:
import 'package:synheart_core/synheart_core.dart';

// Initialize Core SDK
await Synheart.initialize(
  userId: 'anon_user_123',
  config: SynheartConfig(
    enableWear: true,
    enablePhone: true,
    enableBehavior: true,
  ),
);

// Subscribe to HSV updates (core state representation)
Synheart.onHSVUpdate.listen((hsv) {
  print('Arousal Index: ${hsv.meta.axes.affect.arousalIndex}');
  print('Engagement Stability: ${hsv.meta.axes.engagement.engagementStability}');
});

// Optional: Enable interpretation modules
await Synheart.enableFocus();
Synheart.onFocusUpdate.listen((focus) {
  print('Focus Score: ${focus.estimate.score}');
});

await Synheart.enableEmotion();
Synheart.onEmotionUpdate.listen((emotion) {
  print('Stress Index: ${emotion.stressIndex}');
});

// Enable cloud upload (with consent)
await Synheart.enableCloud();

Android (Kotlin)

Kotlin SDK Guide

Complete Android integration guide
Installation:
dependencies {
    implementation("ai.synheart:core-sdk:1.0.0")
}
Basic Usage:
import ai.synheart.core.Synheart
import ai.synheart.core.SynheartConfig

// Initialize
Synheart.initialize(
    userId = "anon_user_123",
    config = SynheartConfig(
        enableWear = true,
        enablePhone = true,
        enableBehavior = true
    )
)

// Subscribe to HSV updates
Synheart.onHSVUpdate.collect { hsv ->
    println("Arousal Index: ${hsv.meta.axes.affect.arousalIndex}")
    println("Engagement Stability: ${hsv.meta.axes.engagement.engagementStability}")
}

// Optional: Enable interpretation modules
Synheart.enableFocus()
Synheart.onFocusUpdate.collect { focus ->
    println("Focus Score: ${focus.estimate.score}")
}

Synheart.enableCloud()

iOS (Swift)

Swift SDK Guide

Complete iOS integration guide
Installation:
dependencies: [
    .package(url: "https://github.com/synheart-ai/synheart-core-sdk-swift.git", from: "1.0.0")
]
Basic Usage:
import SynheartCore

// Initialize
Synheart.initialize(
    userId: "anon_user_123",
    config: SynheartConfig(
        enableWear: true,
        enablePhone: true,
        enableBehavior: true
    )
)

// Subscribe to HSV updates
Synheart.onHSVUpdate.sink { hsv in
    print("Arousal Index: \(hsv.meta.axes.affect.arousalIndex)")
    print("Engagement Stability: \(hsv.meta.axes.engagement.engagementStability)")
}

// Optional: Enable interpretation modules
Synheart.enableFocus()
Synheart.onFocusUpdate.sink { focus in
    print("Focus Score: \(focus.estimate.score)")
}

Synheart.enableCloud()

Privacy & Security

  • Zero Raw Content: No text, mic, URLs, messages
  • On-Device Processing: All inference happens locally
  • No Raw Biosignals: Only derived signals externally
  • Consent-Gated: All cloud uploads require explicit consent
  • Capability-Enforced: Feature access tied to app signature and tenant ID

Performance Benchmarks

MetricTargetTypical
CPU Usage< 2%~1.5%
Memory< 15MB~12MB
Battery Impact< 0.5%/hr~0.3%/hr
HSV Update Latency≤ 100ms~80ms
Cloud Upload Time≤ 80ms~60ms

Available SDKs

Technical Documentation

Use Cases

Mental Health Platforms

Monitor physiological and behavioral signals for emotional state tracking:
// Initialize with emotion and behavior modules
await Synheart.initialize(
  userId: userId,
  config: SynheartConfig(
    enableWear: true,
    enablePhone: true,
    enableBehavior: true,
  ),
);

await Synheart.enableEmotion();

// Monitor stress indicators
Synheart.onEmotionUpdate.listen((emotion) {
  if (emotion.stressIndex > 0.7) {
    showStressAlert();
  }
});

Productivity Apps

Track focus and engagement for productivity optimization:
await Synheart.initialize(
  userId: userId,
  config: SynheartConfig(
    enableWear: true,
    enableBehavior: true,
  ),
);

await Synheart.enableFocus();

// Monitor focus state
Synheart.onFocusUpdate.listen((focus) {
  updateFocusScore(focus.estimate.score);
  if (focus.estimate.score < 0.3) {
    suggestBreak();
  }
});

Research Applications

Collect comprehensive human state data for research:
// Enable all modules for research
await Synheart.initialize(
  userId: participantId,
  config: SynheartConfig(
    enableWear: true,
    enablePhone: true,
    enableBehavior: true,
    capabilityLevel: CapabilityLevel.research, // Requires authorization
  ),
);

// Enable cloud upload for data collection
await Synheart.enableCloud();

Next Steps


Author: Israel Goytom Organization: Synheart AI