Commit Graph

58 Commits

Author SHA1 Message Date
Fimeg
ec3ba88459 feat: machine binding and version enforcement
migration 017 adds machine_id to agents table
middleware validates X-Machine-ID header on authed routes
agent client sends machine ID with requests
MIN_AGENT_VERSION config defaults 0.1.22
version utils added for comparison

blocks config copying attacks via hardware fingerprint
old agents get 426 upgrade required
breaking: <0.1.22 agents rejected
2025-11-02 09:30:04 -05:00
Fimeg
99480f3fe3 fix: resolve frontend approval error and add invalid command handling
- Added missing approveMultiple function to updateApi
- Fixed API endpoint from /updates/bulk-approve to /updates/approve
- Enhanced invalid command handling in both Linux and Windows agents
- Agents now report unknown command types as failed commands back to server
2025-11-01 21:56:31 -04:00
Fimeg
3690472396 feat: granular subsystem commands with parallel scanner execution
Split monolithic scan_updates into individual subsystems (updates/storage/system/docker).
Scanners now run in parallel via goroutines - cuts scan time roughly in half, maybe more.

Agent changes:
- Orchestrator pattern for scanner management
- New scanners: storage (disk metrics), system (cpu/mem/processes)
- New commands: scan_storage, scan_system, scan_docker
- Wrapped existing scanners (APT/DNF/Docker/Windows/Winget) with common interface
- Version bump to 0.1.20

Server changes:
- Migration 015: agent_subsystems table with trigger for auto-init
- Subsystem CRUD: enable/disable, interval (5min-24hr), auto-run toggle
- API routes: /api/v1/agents/:id/subsystems/* (9 endpoints)
- Stats tracking per subsystem

Web UI changes:
- ChatTimeline shows subsystem-specific labels and icons
- AgentScanners got interactive toggles, interval dropdowns, manual trigger buttons
- TypeScript types added for subsystems

Backward compatible with legacy scan_updates - for now. Bugs probably exist somewhere.
2025-11-01 21:34:26 -04:00
Fimeg
bf4d46529f feat: add resilience and reliability features for agent subsystems
Added circuit breakers with configurable timeouts for all subsystems (APT, DNF, Docker, Windows, Winget, Storage). Replaces cron-based scheduler with priority queue that should scale beyond 1000+ agents if your homelab is that big.

Command acknowledgment system ensures results aren't lost on network failures or restarts. Agent tracks pending acknowledgments with persistent state and automatic retry.

- Circuit breakers: 3 failures in 1min opens circuit, 30s cooldown
- Per-subsystem timeouts: 30s-10min depending on scanner
- Priority queue scheduler: O(log n), worker pool, jitter, backpressure
- Acknowledgments: at-least-once delivery, max 10 retries over 24h
- All tests passing (26/26)
2025-11-01 18:42:41 -04:00
Fimeg
528848f476 docs: add v0.1.18 release notes and testing status 2025-11-01 09:48:19 -04:00
Fimeg
8b880b2d5a docs: update README with v0.1.18 and improve update/uninstall sections
- Bump version to 0.1.18
- Add simple update one-liner
- Organize nuclear option and uninstall into dropdowns
- Document agent config file locations
- Reference uninstall.sh script
2025-11-01 09:36:48 -04:00
Fimeg
01c09cefab feat: agent UI redesign and version bump to 0.1.18
- Redesign AgentUpdatesEnhanced with tab-based workflow (pending/approved/installing/installed)
- Add AgentStorage component with disk partition table
- Add AgentScanners component for agent health monitoring
- Fix agent removal not refreshing list (cache invalidation)
- Bump agent version to 0.1.18 (enhanced disk detection)
- Update server default version to 0.1.18
- Add command source tracking (system/manual) migration
- Improve Linux disk detection for all physical mount points
2025-11-01 09:27:58 -04:00
Fimeg
5fd82e5697 fix: namespace rate limiter keys and prevent setup checker interval loops
Rate limiter fix:
- Namespace keys by limit type to prevent counter sharing across endpoints
- Previously all KeyByIP endpoints shared same counter causing false rate limits
- Now agent_registration, public_access, etc have separate counters per IP
- Example: "agent_registration:127.0.0.1" vs "public_access:127.0.0.1"

Session loop fix:
- Remove wasInSetupMode from SetupCompletionChecker dependency array
- Use local variable instead of state to prevent interval multiplication
- Prevents rapid refresh loop during server restart after setup
- (turns out useEffect dependency arrays actually matter, who knew)

Tested:
- First agent registration now succeeds without rate limit (was 429)
- Public access requests don't affect agent registration quota
- No UI flashing during server restart
- Rate limit API endpoints functional (Settings UI needs work)
2025-10-31 19:31:52 -04:00
Fimeg
a90bb31836 merge: bring in session-loop and dashboard fixes from main 2025-10-31 18:36:28 -04:00
Fimeg
5e9c27b7ef fix: handle NULL reboot_reason values from database
The reboot_reason field was defined as string instead of *string, causing
database scan failures when the column contains NULL values. This broke
agent list loading on existing installations after migration.

- Changed reboot_reason to *string in both Agent and AgentWithLastScan structs
- Added DEFAULT empty string to migration for new installations
- Added README section for full server reinstall procedure
2025-10-31 17:34:05 -04:00
Fimeg
e72e9fc16f feat: add host restart detection and fix agent version display
Potential fixes for issues #4 and #6.

Agent version display:
- Set CurrentVersion during registration instead of waiting for first check-in
- Update UI to show "Initial Registration" instead of "Unknown"

Host restart detection:
- Added reboot_required, last_reboot_at, reboot_reason fields to agents table
- Agent now detects pending reboots (Debian/Ubuntu via /var/run/reboot-required, RHEL/Fedora via needs-restarting)
- New reboot command type with 1-minute grace period
- UI shows restart alerts and adds restart button in quick actions
- Restart indicator badge in agent list

The reboot detection runs during system info collection and gets reported back to the server automatically.

Using shutdown command for now until we make the restart mechanism user-adjustable later - need to think on that.
Also need to come up with a Windows derivative outside of reading event log for detecting reboots.
2025-10-31 15:03:59 -04:00
Casey Tunturi
85323884f4 Merge pull request #8 from Fimeg/3-dashboard-is-inconsistent
fix: dashboard severity field name mismatch
2025-10-31 13:30:25 -04:00
Fimeg
08f63ccc7a fix: dashboard severity field name mismatch 2025-10-31 13:27:37 -04:00
Casey Tunturi
93592f2410 Merge pull request #5 from Fimeg/fix/session-loop-bug
Conducted 3 different scenario tests on my bench - considering resolved until reopened: 401 session refresh loop
2025-10-31 12:49:42 -04:00
Fimeg
7b7764115c fix: resolve 401 session refresh loop
Clear all auth state on 401, disable retries, and force logout on setup completion.

Resolves #2
2025-10-31 12:29:15 -04:00
Fimeg
3f9164c7ca fix: complete security vulnerability remediation
Critical Security Fixes:
- Fix JWT secret derivation vulnerability - replace deriveJWTSecret with cryptographically secure GenerateSecureToken
- Secure setup interface - remove JWT secret display and API response exposure
- Fix database migration 012 parameter naming conflict in mark_registration_token_used function
- Restore working Docker Compose environment variable configuration

Security Impact:
- Eliminates system-wide compromise risk from admin credential exposure
- Removes sensitive JWT secret exposure during setup process
- Ensures cryptographically secure JWT token generation
- Fixes agent registration and token creation functionality

Testing:
- Agent registration working properly
- Token consumption tracking functional
- Registration tokens created without 500 errors
- Secure JWT secret generation verified
2025-10-31 10:41:04 -04:00
Fimeg
63cc7f6645 fix: critical security vulnerabilities
- Fix JWT secret derivation vulnerability - replace deriveJWTSecret with cryptographically secure GenerateSecureToken
- Secure setup interface - remove JWT secret display and API response exposure
- Addresses system-wide compromise risk from admin credential exposure
2025-10-31 09:32:34 -04:00
Fimeg
e64131079e add automatic redirect from setup to login after completion
- Add SetupCompletionChecker component that monitors health status
- Automatically redirect to /login when server becomes healthy after setup
- Improves user experience by eliminating manual navigation step
2025-10-31 08:39:16 -04:00
Fimeg
fd4974de21 fix screenshot header text - change Windows Update History to Live Operations 2025-10-31 08:24:37 -04:00
Fimeg
23f8ea539e fix README screenshot layout - swap Live Operations with Linux Update History only 2025-10-31 08:23:20 -04:00
Fimeg
982750e694 fix welcome mode redirect - add missing /api/health endpoint
- swap Live Operations to main screenshots section
- remove WebSocket reference from future features
- better screenshot layout with Live Operations prominent
2025-10-31 08:21:49 -04:00
Fimeg
b9dcdcf71b fix bootstrap authentication - use matching redflag_bootstrap password 2025-10-31 08:10:53 -04:00
Fimeg
6af159f1bb remove test-agent from version control 2025-10-31 07:41:53 -04:00
Fimeg
e5d59eac02 fix deployment workflow - manual bootstrap copy and restart 2025-10-31 07:41:00 -04:00
Fimeg
44bb05ca5d added .env bootstrap and fallback 2025-10-31 06:54:34 -04:00
Fimeg
a3e3ac33a7 docs: improve screenshot layout with collapsible section 2025-10-30 22:23:26 -04:00
Fimeg
a92ac0ed78 v0.1.17: UI fixes, Linux improvements, documentation overhaul
UI/UX:
- Fix heartbeat auto-refresh and rate-limiting page
- Add navigation breadcrumbs to settings pages
- New screenshots added

Linux Agent v0.1.17:
- Fix disk detection for multiple mount points
- Improve installer idempotency
- Prevent duplicate registrations

Documentation:
- README rewrite: 538→229 lines, homelab-focused
- Split docs: API.md, CONFIGURATION.md, DEVELOPMENT.md
- Add NOTICE for Apache 2.0 attribution
2025-10-30 22:17:48 -04:00
Fimeg
3940877fb2 fix: use Docker volume for server config instead of bind mount
- Change server-config from bind mount to named volume
- Fixes permission denied errors when saving configuration
- Config now persists properly across container restarts
2025-10-29 15:37:18 -04:00
Fimeg
0b07ca4c5e fix: improve setup error handling and health endpoint
- Add /api/v1/health endpoint for web app compatibility
- Add detailed error logging to setup handler
- Show actual error messages when config save fails
- Helps debug permission and filesystem issues
2025-10-29 15:31:46 -04:00
Fimeg
8abbacbec4 feat: add web UI service to docker-compose
- Add Dockerfile for React web application
- Add nginx configuration for API proxying
- Add web service to docker-compose.yml
- Web UI now accessible on port 3000
- API requests proxied to backend server on port 8080
2025-10-29 15:15:45 -04:00
Fimeg
8252b9edd5 fix: add Windows binaries to gitignore
Prevent future commits of redflag-agent.exe
2025-10-29 15:15:38 -04:00
Fimeg
c437ecd730 fix: update gitignore to exclude aggregator-agent binary
Add aggregator-agent/aggregator-agent to gitignore to prevent
future commits of compiled binaries.
2025-10-29 14:06:33 -04:00
Fimeg
88c58c1b4b fix: remove compiled binaries from repository
Binaries should be built locally, not committed to git.
  This fixes clone permission issues.
2025-10-29 14:03:47 -04:00
Fimeg
1f520fd9e6 testing: web-based server setup with automatic restart
- Add React setup form matching our design system
- Implement automatic server restart after configuration
- Add WelcomeChecker component for proper routing
- Update API to handle setup endpoints and restart logic
- Improve setup workflow with proper loading states and redirects

Testing complete setup workflow from welcome mode to login.
2025-10-29 13:37:02 -04:00
Fimeg
73fb8d49b0 Implement web-based welcome mode configuration 2025-10-29 13:16:17 -04:00
Fimeg
b1ea9e72ad Add welcome mode for server configuration 2025-10-29 13:08:52 -04:00
Fimeg
1acddb58a5 Auto-configure server on first Docker run 2025-10-29 13:01:28 -04:00
Fimeg
237e04531f Fix duplicate volumes in docker-compose 2025-10-29 12:54:26 -04:00
Fimeg
5251825ac1 Add agent distribution system 2025-10-29 12:50:00 -04:00
Fimeg
c027a1da6c Fix Go version and agent workflow 2025-10-29 12:43:18 -04:00
Fimeg
740d75f3cf Docker deployment for most users 2025-10-29 12:37:00 -04:00
Fimeg
c48ea033fc Fix windowsupdate package missing in fresh clones 2025-10-29 12:15:30 -04:00
Fimeg
0d591e2e21 Fix missing utils package for fresh clones
- Remove aggregator-server/internal/utils/ from gitignore
- Add utils/version.go with version comparison functions
- Resolves 'does not contain package' error when cloning from GitHub
2025-10-29 12:08:30 -04:00
Fimeg
b34a8f461b Add go mod tidy to build process for fresh clones
- Update Makefile to include go mod tidy in all build targets
- Add build-all target specifically for fresh clone deployment
- Update README to include go mod tidy in manual build instructions
- Resolves 'updates to go.mod needed' error after module path changes
2025-10-29 12:00:11 -04:00
Fimeg
e40cb14945 Fix module paths for GitHub repository structure
- Update go.mod files to use github.com/Fimeg/RedFlag module path
- Fix all import statements across server and agent code
- Resolves build errors when cloning from GitHub
- Utils package (version comparison) is actually needed and working
2025-10-29 11:53:20 -04:00
Fimeg
56ed1069e0 Add Go prerequisite to documentation 2025-10-29 11:34:59 -04:00
Fimeg
3bf69a6e2c Remove marketing buzzwords and add attribution 2025-10-29 11:18:14 -04:00
Fimeg
27760a1574 Add Apache 2.0 attribution for windowsupdate package
- Add THIRD_PARTY_LICENSES.md with proper attribution to Zheng Dayu
- Update README.md with third-party license section
- Document Apache 2.0 license compatibility
- Remove marketing buzzwords from README
2025-10-29 10:54:25 -04:00
Fimeg
03fee29760 v0.1.16: Security overhaul and systematic deployment preparation
Breaking changes for clean alpha releases:
- JWT authentication with user-provided secrets (no more development defaults)
- Registration token system for secure agent enrollment
- Rate limiting with user-adjustable settings
- Enhanced agent configuration with proxy support
- Interactive server setup wizard (--setup flag)
- Heartbeat architecture separation for better UX
- Package status synchronization fixes
- Accurate timestamp tracking for RMM features

Setup process for new installations:
1. docker-compose up -d postgres
2. ./redflag-server --setup
3. ./redflag-server --migrate
4. ./redflag-server
5. Generate tokens via admin UI
6. Deploy agents with registration tokens
2025-10-29 10:38:18 -04:00
Fimeg
b3e1b9e52f Bump agent version to 0.1.8 2025-10-25 12:40:16 -04:00