feat: redact file contents from chat and put latest files into system prompt

[thecodacus]

Re-enable Context Optimization with Toggle Feature

Overview

This PR re-enables the previously implemented context optimization feature (from PR #578) while adding a user-configurable toggle in the settings tab. This allows users to choose whether they want to use context optimization based on their specific needs and the LLM model they're using.

Key Changes

1. Context Optimization Toggle

• Added a new switch in the Features tab for enabling/disabling context optimization
• Implemented persistent storage of the setting using cookies
• Added new state management through enableContextOptimizationStore

2. Integration with Chat System

• Modified chat implementation to pass context optimization flag through the API
• Updated stream-text functionality to conditionally apply optimization
• Re-enabled previously commented out code for file content handling

Technical Details

Settings Management

• Added new contextOptimizationEnabled state in useSettings hook
• Implemented cookie persistence for the setting
• Added enableContextOptimization callback for toggle handling

System Changes

• Modified the chat API endpoint to accept contextOptimization parameter
• Updated streamText to conditionally apply optimization based on the toggle
• Re-enabled file context integration with system prompts when optimization is active

Testing

• Verified toggle functionality persists across sessions
• Tested chat behavior with optimization enabled and disabled
• Verified file context handling with various LLM models
• Confirmed proper state management and API integration

Migration Impact

• No breaking changes
• Feature is opt-in through UI toggle
• Maintains backward compatibility with existing chat functionality
• No migration steps required for existing installations

Future Improvements

• Consolidate feature flags into a single configuration map (noted in TODO)
• Add analytics for feature usage
• Implement model-specific optimization defaults
• Add documentation about optimal use cases for different models

Preview

Context.Optimization.demo.mp4

[traflagar]

Very important feature!