后端设计治理:批次 0-4 全部完成(安全/部署/一致性/结构/架构)

按 ROADMAP §3.1 治理批次推进的后端设计审查整改:

- 批次 0(安全):/api/status/{task_id} 补 JWT 鉴权与任务归属校验;
  pythonocc_available 真实探测;bcrypt 超 72 字节显式拒绝;
  SECRET_KEY/RUSTFS_* 惰性校验,代码侧弱默认移除
- 批次 1(部署正确性):主处理链路改走 RustFS(分派入参 stp_file_id 化,
  worker 按 object_key 下载);AUTO_MIGRATE 开关 + 迁移目录 alembic/→migrations/
  修复包遮蔽(自动迁移此前从未真正生效);OCC 镜像改 conda 原生执行 +
  基础镜像 tag 锁定;compose 关键项改 ${VAR:?} 强制显式配置
- 批次 2(任务一致性):删除 Redis 进程内存回退,PG 为任务状态单一事实源;
  批量元数据入库(processing_tasks.batch_id,迁移 a3f8c2d91e47);
  型腔失败任务标 failed 不再静默 completed;事务边界收口
  (数据本体写 flush-only、失败先回滚再置 failed、进度更新保留即时 commit)
- 批次 3(API 与代码结构):592 行 advanced_router 拆为 design/cost/machining/
  export 四子路由,请求体全量 Pydantic 化;ROUTE_MODULES + route_registry
  (/api/health 呈现 degraded,DEBUG fail fast);纯计算端点统一 to_thread;
  StorageIntegrationService 按职责三拆;MAX_FILE_SIZE 接线生效、
  celery 复用 Settings.redis_url;管理员重置密码改 JSON body(端到端断裂修复);
  openapi.json 重导出(76 paths)+ 前端 gen:api
- 批次 4(架构演进):共享 ORM 按模块拆分(shared/models/base.py + identity.py、
  moldinsight/models/、inventory/models/,删除三条无使用方的跨模块
  relationship,跨模块桥接收敛为裸 FK 硬规则,无兼容 facade);
  OCC executor 重建补 cancel_futures=True(消除旧队列被慢恢复线程
  并行消化的数据竞争);OCC 吞吐方案设计先行
  (docs/topics/performance/OCC_THROUGHPUT.md);顺手清偿 D15
  (vite.config.ts 未用参数致 npm run build 失败)

测试基线:125 passed, 2 skipped(pytest + sqlite+aiosqlite;归属边界、
路由契约、配置治理、鉴权回归等随批新增)
文档同步:STATUS / TECH_DEBT / ROADMAP / ARCHITECTURE / API_CONTRACT /
OPERATIONS / AGENTS

Co-Authored-By: Claude Code <noreply@anthropic.com>
This commit is contained in:
2026-09-17 16:15:49 +08:00
parent 4537faf2c4
commit 0e6b3b1811
82 changed files with 6513 additions and 3709 deletions
+76
View File
@@ -0,0 +1,76 @@
"""批次 3(D14)回归:配置治理。
- settings.redis_url 成为 Redis 连接串唯一拼装点(celery_app 不再自拼)
- MAX_FILE_SIZE 不再是死配置:上传处理器接 settings(此前硬编码 50MB)
"""
import pytest
from shared.config.settings import Settings
def _fresh_settings(monkeypatch, **env):
for key, value in env.items():
monkeypatch.setenv(key, value)
return Settings()
def test_redis_url_without_password(monkeypatch):
s = _fresh_settings(
monkeypatch,
REDIS_HOST="redis-svc", REDIS_PORT="6380", REDIS_PASSWORD="", REDIS_DB="2",
)
assert s.redis_url == "redis://redis-svc:6380/2"
def test_redis_url_with_password(monkeypatch):
s = _fresh_settings(
monkeypatch,
REDIS_HOST="redis-svc", REDIS_PORT="6379", REDIS_PASSWORD="sec ret", REDIS_DB="0",
)
assert s.redis_url == "redis://:sec ret@redis-svc:6379/0"
def test_celery_app_reuses_settings_redis_url():
"""celery_app 的 broker/backend 必须等于 settings.redis_url(消除两份拼装实现)。"""
pytest.importorskip("celery")
import celery_app
from shared.config.settings import settings
assert celery_app.app.conf.broker_url == settings.redis_url
assert celery_app.app.conf.result_backend == settings.redis_url
def test_upload_handler_uses_settings_max_file_size(monkeypatch):
"""MAX_FILE_SIZE 从 .env 一路生效到上传校验(不再是死配置)。"""
pytest.importorskip("minio") # upload_router 导入链含 rustfs_storage
from shared.config import settings as settings_module
from shared.utils.file_handler import FileHandler
monkeypatch.setattr(settings_module.settings, "MAX_FILE_SIZE", 10)
handler = FileHandler(
upload_dir=settings_module.settings.UPLOAD_DIR,
max_file_size=settings_module.settings.MAX_FILE_SIZE,
)
assert handler.max_file_size == 10
import asyncio
class _FakeUpload:
filename = "big.step"
@staticmethod
async def read():
return b"x" * 11
with pytest.raises(ValueError):
asyncio.run(handler.save_uploaded_file(_FakeUpload()))
def test_router_handlers_wired_to_settings():
"""路由模块的 file_handler 实例必须接 settings(而非构造默认值)。"""
pytest.importorskip("minio")
from shared.config.settings import settings
from moldinsight.api import upload_router, batch_router
assert upload_router.file_handler.max_file_size == settings.MAX_FILE_SIZE
assert batch_router.file_handler.max_file_size == settings.MAX_FILE_SIZE