App - Main Website/Server System

Just keeping track of mayor things, can't really keep up with every little detail. There's a lot happening really.

Version

0.3.5.x

New stuff

• Smart News (which can add to context packages and research workspaces with context)

• Updated editors for wiki, content pages and content sections for now

Version

0.3.4.x

New stuff

• Syscontrol service

middleman service to basically have a seperate permission layer to control and likely handle various post-install service-related stuff in the future

• Services Dashboard
• manage.sh added syscontrol and research service management/reinstall and such
• nginx:regenerate regenerates nginx main site and reverb reverse-proxy configs
• cert certificate management artisan commands

Available commands for the "cert" namespace:

• cert:check Check all ACME certificates and renew those due for renewal. For scheduler/cron use.
• cert:issue Issue an ACME certificate for a setting. Falls back to self-signed on failure if requested.
• cert:rescue Emergency: Generate self-signed certificates without database access (for nginx recovery)
• cert:self-signed Generate a self-signed certificate for emergency recovery when ACME fails
• cert:status Display the status of all certificate settings

Version

0.3.3.x

Updates

• App download page overhaul
• Blog page 'Featured' tag refresh

Code cleanups

• Legacy messaging code and views removed
• Service installers updated
• Live service now using same approach to config as the research service, which is based on shared secrets with laravel, generated at installtime
• Shared key rotation artisan command, creating a new shared key and writing it to all .env files for services to read config

Version

0.3.2.5

Fixes

• contacts list depending on previous conversations to show a contact

Version

0.3.2.2-0.3.2.4

New Features

• Laravel 11 -> 12
• Content Slider features
• Blog posts & Slides
• News slides

Fixes

• various fixes, api improvements

Version

0.3.2.1

New Features

• Mobile/App WebView Knowledge Graph

Fixes

• Menu Highlighting improved
• various fixes, api improvements

Version

0.3.2.0

New Features

• Research workspaces

Version

0.3.1.0

New Features

• Context packages
• Image analysis

Version

0.3.0.9

Fixes

• A Lot

Version

0.3.0.8

New Features

• Instant Message Attachments Images and files can now be sent in instant messages

Version

0.3.0.7

New features

• App release channels

Version

0.3.0.6

New features

• ICE Caching/queuing to avoid timing issues with websocket ICE server subscriptions

Version

0.3.0.5

New features

• Call logs (webrtc overview, admin section)

Version

0.3.0.4

New features

• Android app ringtones

Version

0.3.0.3

New features

• Token - having devices online - status display on token list page

Fixes

• Multimodal models-list now filtering when ajax loaded, this only worked if not ajax loading the /multimodal page

Version

0.3.0.2

• Work on ajax'ing the site, required for uninterrupted voice and video calls
• V2 messenger complete rewrite as a persistant widget
• Updating cyberpunk theme for better contrast

New Features

• Kewl, theme specific Ajax Loading Overlay
• Realtime theme switching

Version

0.3.0.1

• User permissions save fix

Version

0.3.0.0

New Features

• Instant Messaging - can instant-message between users, just text-based for now, foundation in place for more advanced stuff like images, files, audio, direct-voice chat/video chat
• Internal Messages - can send messages like email between users
• Notifications - foundation, not in use yet

Recent Fixes

• Changelog page upgrade - Bit more interesting (hopefully) changelog display

Version

0.2.5.1

Recent Fixes

• Live voice preference system - Improved voice preference handling and persistence
• Live chat session status banner - Enhanced status indicators for live sessions
• Audio device preference - Better audio device selection and management
• Live image aspect ratio - Support for various image aspect ratios in live chat
• Active chat selection - Smart selection of most recent non-live chat session

Recent Features

• Live chat functionality - Real-time audio/text communication with AI
• Live voice preference system - Customizable voice preferences per user
• Live image support - Image sharing and processing in live chat
• Live image resize - Dynamic image resizing capabilities
• Live image quality controls - Fine-tuned quality settings
• Live image colorspace options - Advanced colorspace configuration
• Live image bit depth - Configurable bit depth settings
• Messages system - Comprehensive messaging infrastructure
• Connections management - Enhanced connection handling
• Inbox system - Full-featured inbox with organization
• Video generation - AI-powered video creation
• Video generation image resampling - Advanced image processing for videos

Audio Player & TTS System

Versions

• Chunked Audio Player: 0.7.1
• Non-Chunked Audio Player: 0.2

Optimizations

• AudioWorklet dedicated audio thread with resampling - Improved performance and audio quality
• Enhanced audio streaming - Better buffering and playback stability
• Audio quality processing - Advanced audio processing pipeline

Live Chat System

Version

0.3.6.1

Features

• Message context aware audio monitoring - Smart audio monitoring based on message context
• Scroll to message - Automatic scrolling to relevant messages
• Context reset - Ability to reset conversation context
• Real-time audio streaming - Low-latency audio communication
• Enhanced message handling - Improved message processing and display

Python Service - Gemini Live

Version

0.5.3

Features

• Context reset in audio processing - Proper handling of context resets during audio processing
• Live image support - Real-time image processing and transmission
• Live image resize - Dynamic image resizing on the fly
• Live image quality controls - Configurable image quality settings
• Live image colorspace options - Support for various colorspaces
• Live image bit depth - Configurable bit depth for images

Fixes

• Thinking mode setting and reconnect - Fixed issues with thinking mode during reconnections
• Connection stability - Improved connection reliability and error recovery
• Error handling - Enhanced error handling and logging

Android Client App

Version Information

• App Version: 0.3.9
• Build Number: 420
• TTS SSE Version: 1.3
• Live Chat Version: 1.3.2

Features

• Context packages
• Research Workspaces
• AiChat Custom Ringtone songs - 2 so far
• Audio calls - in the works, sortof working
• Internal Messaging - barebones
• Instant Messaging - barebones, now with attachments
• Live voice preference and language - Customizable voice preferences with language support
• Enhanced audio streaming - Improved audio playback and streaming
• Connection management - Better connection handling and reconnection logic
• Error handling - Comprehensive error handling and user feedback

Desktop Client App

Version Information

• App Version: 0.0.5
• Build Number: 56
• Format: MSIX
• Platform: Windows (Mac Catalyst support in project)

Current Status

Early development skeleton - basic functionality only. Currently fixing up the build process and getting the app to run. Basically useable at this point for most things.

Features

• Research Workspaces
• AI Chat - super early
• Instant Messaging - woop woop
• User Authentication - Login functionality with token-based authentication
• User Profile Display - Shows logged-in user's name and initials
• WebSocket Integration - Connects to Reverb WebSocket server for real-time communication
• Channel Subscriptions - Listens to user and conversation channels
• Conversation List - Basic conversation listing infrastructure
• Message Display - Foundation for message viewing
• System Tray Support - Windows system tray integration
• Local Database - SQLite database for local data storage

Technical Stack

• Framework: .NET MAUI 10.0
• Platforms: Windows (primary), Mac Catalyst (configured)
• WebSocket: PusherClient library for Reverb integration
• Database: SQLite-net-pcl
• UI: MAUI XAML with MVVM pattern (CommunityToolkit.Mvvm)
• Packaging: MSIX for Windows distribution

Future Development

The app is being developed to provide similar functionality to the Android app, with potential for:

• Browser-mode integration - actually doing some of that now
• Direct API integration - this is more or less there
• C# WebRTC audio/video library integration for improved performance and stability
• Full messaging and chat capabilities
• Audio and video calling support