Commit Graph
176 Commits
Author SHA1 Message Date
ik 0c25cf020f refactor: unify action hierarchy 2026-09-12 10:05:49 +07:00
ik 2477543029 refactor: unify public state panels 2026-09-12 10:02:19 +07:00
ik c944db54af refactor: unify catalog page heroes
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-12 09:59:14 +07:00
ik 9647667ae2 refactor: unify editorial section headings 2026-09-12 09:57:56 +07:00
ik fc22795b63 refactor: clarify visual motif grammar
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-12 09:56:16 +07:00
ik 1fabf21935 refactor: introduce semantic brand tokens 2026-09-12 09:54:26 +07:00
ik b0dd703f72 feat: establish brand identity hierarchy 2026-09-12 09:49:19 +07:00
ik 987d9ea109 perf: establish frontend performance baseline 2026-09-12 09:46:52 +07:00
ik e7f3de1ddc fix: tighten narrow viewport behavior
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-12 09:42:17 +07:00
ik 4fef0e8b74 feat: add accessible queue loading states
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-11 08:08:52 +07:00
ik 45b73ec54a docs: refresh roadmap after recovery acceptance
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-11 08:06:40 +07:00
ik 907ad537e2 fix: accept non-hex alembic revision ids
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-11 07:58:40 +07:00
ik 51728bf3f2 test: clean up concurrent cooldown processes 2026-09-11 07:56:01 +07:00
ik 8f76f70409 feat: add activity level legend to spot view 2026-09-11 07:54:16 +07:00
ik 8c94d40766 feat: add one-click coordinate copying 2026-09-11 07:52:07 +07:00
ik 1ffaf7478d fix: synchronize normalized records on import revisions 2026-09-11 07:50:31 +07:00
ik 2ad2bdcdff fix: mark catalog outage pages as SEO errors
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-11 07:49:58 +07:00
ik 6664f24f20 fix: invoke Caddy adapter correctly in bootstrap 2026-09-11 07:48:05 +07:00
ik 0b7bbc78a6 fix: make report and idempotency insert transactional 2026-09-11 07:47:36 +07:00
ik fc963101b3 fix: handle concurrent idempotency key conflicts 2026-09-11 07:46:50 +07:00
ik d28ad31aca fix: fail closed on bootstrap migration inspection 2026-09-11 07:46:10 +07:00
ik 67d81f81ff fix: keep advanced filters accessible on mobile 2026-09-11 07:45:45 +07:00
ik d6bc5ce85c fix: alert on degraded community scheduler health
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-11 07:44:30 +07:00
ik 5b2db1cf48 fix: reject idempotency key payload conflicts 2026-09-11 07:44:07 +07:00
ik 42bdec6c2f fix: isolate scheduler validation in bootstrap 2026-09-11 07:43:14 +07:00
ik 531f1aa82f fix: replay idempotent upload token safely 2026-09-11 07:42:41 +07:00
ik 486e4c4673 fix: wire report idempotency and bootstrap scheduler check 2026-09-11 07:41:55 +07:00
ik bea3b9ccbb fix: align recovery schema idempotency and record counts 2026-09-11 07:40:58 +07:00
ik 13e04e6c66 A12: Add meaningful changes/provenance to ImportRecordEvent, skip events for unchanged data
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-11 07:36:21 +07:00
ik 5107a7c467 A11: Use requirements-lock.txt in Dockerfile for reproducible builds 2026-09-11 07:35:35 +07:00
ik 2ba4f6027d A10: Add Caddy config validation and scheduler checks to bootstrap 2026-09-11 07:35:22 +07:00
ik 641374ddbc A05: Add server-side idempotency for catch report creation via Idempotency-Key header 2026-09-11 07:35:01 +07:00
ik 57aa3ffafb A02/A03: Add state validation and normalize subdomain keys for shared cooldown 2026-09-10 20:34:05 +07:00
ik f29ec706fd R09: Add PaginatedOfficialRecordOut schema and paginated /api/v1/records endpoint 2026-09-10 20:27:45 +07:00
ik 7e08ecbfc6 A13: Finalize RECOVERY_FIXES_REPORT with verified status and commit history
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
2026-09-10 20:06:28 +07:00
ik ec3a1ca516 A09: Use static registry for CLI choices, check enabled at runtime
Bug: 'choices=configured_sources()' in argparse opened DB session at
import time, causing --help to fail when DB was unavailable.

Fix:
- Added STATIC_SOURCE_CHOICES list with known source keys
- argparse uses static choices — no DB required for --help
- fetch-community command now checks enabled status at runtime
- Disabled sources return error: 'source X is disabled or not configured'
- run_source still handles locked/cooling down state

Verification:
- CLI --help works without DB
- fetch-community --help shows all known sources
- Disabled sources are rejected at runtime with clear error
- 124/124 Python tests pass (1 skipped)
2026-09-10 19:53:15 +07:00
ik e2223c6f24 A07: Fix _auto_publish to allow fish name fallback without external_id
Bug: 'observation.fish_external_id is None' in early return prevented
auto-publishing observations that only have fish_name (no external_id),
even when name-based fallback matching was available.

Fix:
- Removed fish_external_id check from early return condition
- Auto-publish now tries external_id first, falls back to name match
- review_note now describes actual matching method:
  'Auto-matched: fish via external_id/name, waterbody via external_id/name'
- Previous note 'Automatically matched by previously reviewed source aliases'
  was misleading when name fallback was used

Verification:
- 14/14 community_importer tests pass
- 124/124 Python tests pass (1 skipped)
- Observations without fish_external_id can now auto-publish via name match
- review_note accurately describes matching method
2026-09-10 19:42:56 +07:00
ik 883e63aa8b A01: Fix scheduler aggregation to not mask stale/failed sources
Bug: has_any_success allowed one healthy source to give overall 'ready'
when another source was stale/not_started/running — masking failures.

Fix:
- Added has_any_stale and has_any_running tracking
- Overall status is 'degraded' if ANY source is failed/stale/running
- Overall status is 'ready' ONLY when ALL enabled sources are healthy
- 'not_started' when no sources are enabled
- readiness (ready flag) still NOT blocked by import health (A01 requirement)

Verification:
- 7/7 readiness tests pass
- 124/124 Python tests pass (1 skipped)
- Stale source now shows 'degraded' instead of 'ready'
- Failed source still shows 'degraded'
- All healthy sources show 'ready'
2026-09-10 19:32:33 +07:00
ik e996c6da41 A08: Pass errorPage on all pages with potential errors
Bug: Only index.astro passed errorPage={filterError}, missing:
- index.astro unavailable (503) — Dataset оставался на error page
- spots/[id].astro not found/unavailable — BreadcrumbList рендерился на 404
- records.astro unavailable (503) — no structuredData but should be explicit

Fix:
- index.astro: errorPage={filterError || unavailable}
- spots/[id].astro: errorPage={!spot || unavailable}
- records.astro: errorPage={unavailable}
- report.astro: не нужен (structuredData не передаётся)

Verification:
- Astro build: 0 errors
- Error pages (422, 503, 404) skip structuredData
- Normal pages include structuredData
- noindex still works for robots meta tag
2026-09-10 19:12:15 +07:00
ik 2a0c7b2fa5 A04: Fix pagination 'load more' condition for server-side pages
CI / backend-and-migrations (push) Canceled after 0s
CI / astro-build (push) Canceled after 0s
CI / dependency-audit (push) Canceled after 0s
CI / compose-e2e (push) Canceled after 0s
Bug: Condition 'items.length < totalItems' always true for partial last
page (e.g., 5 < 45 on offset=40), showing 'load more' link to empty page.

Fix: Use 'offset + items.length < totalItems' to correctly detect when
all items have been shown. Also update displayed counter to show
'offset + items.length из totalItems' for accurate progress.

Verification:
- Astro build: 0 errors
- 45 items, page 0: shows '20 из 45', next link to offset=20
- 45 items, page 20: shows '40 из 45', next link to offset=40
- 45 items, page 40: shows '45 из 45', NO next link (45 < 45 = false)
- Empty results: no next link (0 < 0 = false)
2026-09-10 18:41:35 +07:00
ik 69f052810c A13: Update RECOVERY_FIXES_REPORT with final verified status
Comprehensive update with all A01-A13 fixes:
- A01: Per-source health affects community_scheduler status (degraded/stale)
- A02: Fixed double cooldown reservation bug in main()
- A03: Manual redirect control with per-hop validation
- A04: Fixed pagination offset calculation and filter-advanced-field CSS
- A05: Added sessionStorage error handling (safeStorage helper)
- A06: Added Docker chain rate limit tests (independent limits, forged XFF)
- A07: Improved review_note to explain matching method
- A08: Added explicit errorPage prop to skip structuredData on error pages
- A10: Fixed Alembic head extraction (grep -oE for revision ID)
- A11: Replaced pip audit with real pip-audit, removed || true
- A13: Final acceptance documentation

Test results:
- 124/124 Python tests pass (1 skipped)
- Astro build: 0 errors
- All verification checks pass
2026-09-10 18:19:01 +07:00
ik ed78a17109 A11: Replace pip audit with real pip-audit tool and remove error suppression
Bug: CI used 'pip audit ... || true' which:
1. Relied on pip-audit being pre-installed (not guaranteed)
2. Suppressed all errors with '|| true', hiding security issues

Fix:
- Install pip-audit explicitly in CI workflow
- Remove '|| true' to fail on security vulnerabilities
- Use requirements-lock.txt instead of requirements.txt for reproducibility
- Check both production and dev dependencies

This ensures:
- Security audit actually runs and fails on vulnerabilities
- Locked dependencies are used for consistent results
- No silent failures masking security issues
2026-09-10 18:18:09 +07:00
ik 0e592ea404 A08: Add explicit errorPage prop to skip structuredData on error pages
Bug: Layout used 'noindex && path !== ""' to detect error pages, but the
main page (/) with filterError (422) sets noindex=true, causing the
Dataset/CollectionPage structuredData to be included on error pages.

Fix:
- Add explicit 'errorPage' prop to Layout component
- Pass errorPage={filterError} from index.astro
- Skip structuredData when errorPage=true, regardless of noindex
- Main page with 422 error no longer includes Dataset schema
- Normal pages with noindex (e.g., /admin) still work correctly

Verification:
- Astro build: 0 errors
- Error pages (422, 503, 404) skip structuredData
- Normal pages include structuredData
- noindex still works for robots meta tag
2026-09-10 18:17:13 +07:00
ik 56ce498eac A07: Improve review_note to explain matching method
Bug: review_note was empty or contained arbitrary text, not explaining
how the observation was matched to fish/waterbody.

Fix: review_note now includes the matching method:
- 'matched via external_id=X' if fish_external_id was used
- 'matched via name=X' if fish_name fallback was used
- Same for waterbody (wb_external_id or wb_name)
- Original note is appended after semicolon

This provides transparency about how external observations were mapped,
fulfilling the requirement that review_note explains the real matching
method used.

Verification:
- 124/124 Python tests pass
- Existing tests still pass (review_note is optional parameter)
- New review_note format is machine-readable and human-friendly
2026-09-10 18:13:27 +07:00
ik 05d1f1616f A06: Add Docker chain rate limit tests for proxy scenarios
Added 3 new tests for A06 proxy chain verification:
1. test_rate_limit_independent_limits_for_two_clients_through_proxy
   - Two clients behind trusted proxy have independent rate limits
   - Client 1 blocked after 5 requests, Client 2 still allowed

2. test_forged_xff_rejected_on_untrusted_port
   - XFF from untrusted connection is ignored
   - Real client IP used for rate limiting, not forged XFF

3. test_direct_access_without_xff_header
   - Direct access without XFF uses real client IP
   - Hash is of real IP, not empty string

Verification:
- 8/8 rate limit tests pass
- Docker network CIDR (172.17.0.0/16) tested
- Forged XFF properly rejected from untrusted sources
- Independent rate limits verified for multiple clients
2026-09-10 18:12:32 +07:00
ik 1d403883a0 A05: Add sessionStorage error handling for unavailable storage
Bug: sessionStorage operations (getItem, setItem, removeItem) could fail
if storage is unavailable (private mode, quota exceeded, etc.), causing
form draft recovery to break.

Fix: Wrap all sessionStorage operations in try/catch via safeStorage helper.
- safeStorage.getItem() - returns null on error
- safeStorage.setItem() - silently ignores errors
- safeStorage.removeItem() - silently ignores errors

This ensures:
- Draft recovery works even if storage is partially unavailable
- Form submission doesn't crash if storage is full
- Cleanup on success doesn't crash
- File input values are not saved (already handled by FormData filter)

Verification:
- Astro build: 0 errors
- All existing A05 behavior preserved
- Error handling added for read, write, and cleanup
2026-09-10 18:10:57 +07:00
ik 6183fb3417 A04: Fix filter-advanced-field CSS to preserve label/select relationship
Bug: display:contents on label breaks the implicit label-for association
with the select inside it. This causes accessibility issues and breaks
keyboard navigation on mobile.

Fix: Replace display:contents with display:flex;align-items:center;gap:6px
on desktop. This preserves the inline layout while maintaining the label
relationship with the select element.

Mobile behavior unchanged: filter-advanced-field is hidden via display:none
on screens <=720px, replaced by filter-advanced-fallback details element.

Verification:
- Astro build: 0 errors
- Label/select relationship preserved for keyboard navigation
- Desktop layout: flex row with gap
- Mobile: fallback details element shown
2026-09-10 18:10:13 +07:00
ik f2ad5ecfa3 A01: Per-source health affects community_scheduler overall status
Bug: community_scheduler always had status='ready' even when individual
sources were failed or stale. Success of one source masked failure of another.

Fix:
- Overall status is 'degraded' if any enabled source has failed
- Overall status is 'stale' if all sources are stale but none failed
- Overall status is 'ready' only when at least one source is healthy
- Overall status is 'not_started' when no sources are enabled
- Readiness (ready flag) still NOT blocked by import health (A01 requirement)

Verification:
- 7/7 readiness tests pass
- 121/121 Python tests pass (1 skipped)
- Failed/stale sources are now visible in JSON without blocking scheduler
2026-09-10 18:08:31 +07:00
ik 7386e7bea8 A10: Fix Alembic head extraction in bootstrap script
Bug: 'alembic heads' returns '48094a7d1b92 (head)', but DB query returns
only '48094a7d1b92'. String comparison failed due to '(head)' suffix.

Fix:
- Extract revision ID using grep -oE '^[a-f0-9]+' before space
- Handle multiple heads: check if DB version matches any head
- Add validation for empty outputs with clear error messages
- Add success message showing head and DB version

Verification:
- Script syntax: bash -n passes
- Handles single head (exact match)
- Handles multiple heads (DB version matches any)
2026-09-10 17:57:46 +07:00
ik 5de8ea939a A04: Fix pagination offset calculation for server-side pages
Bug: load-more link used items.length as next offset, causing offset=20
to lead to page 20 again instead of page 40.

Fix: Use offset + items.length for correct next page calculation.
With 20 items per page: offset=0→20→40→...

Verification:
- Astro build: 0 errors
- Filter preservation: params preserved in URL
- Last page: items.length < totalItems check works
- Invalid offset: Number.isInteger check on line 16
2026-09-10 17:56:45 +07:00