sion/video-create
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
114 Commits 2 Branches 0 Tags
feat/agent-ui
Commit Graph

114 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
sion123
a3d823f81f chore(db): 更新 SQLite 数据库 WAL 和 SHM 文件 
数据库预写日志和共享内存文件随数据库操作自动更新
 2026-05-08 22:19:11 +08:00
sion123
401cc129b5 feat(chat): 为图片附件添加类型标识以支持多类型附件 
在图片消息的接口类型中显式添加 `type: 'image'` 属性，为后续支持多种附件类型（如视频、文件等）做好类型基础。
 2026-05-08 03:16:48 +08:00
sion123
5087d77f23 fix(chat): 修复重连后对话状态丢失导致消息发送失败的问题 
在 WebSocket 重连场景下，服务端可能丢失 `conversationId` 状态，导致后续消息发送被拒绝。通过在客户端消息中携带 `conversationId`，并在服务端添加 fallback 恢复逻辑，确保重连后仍能正常发送消息。

同时优化了 `pendingMessage` 类型定义，支持存储待发送的图片附件，修复了延迟发送场景下图片丢失的问题。
 2026-05-08 03:15:21 +08:00
sion123
7440ade66d feat(assets): 优化资产预览性能并添加资源管理器连接状态提示 
- 使用缩略图替代原图展示，通过 sharp 库生成缓存缩略图
- 优化资产分组逻辑，避免不必要的重计算
- 添加 WebSocket 连接状态提示到输入框
- 使用 `useCallback` 和 `useRef` 优化组件渲染性能
- 添加 AbortController 支持请求取消，防止内存泄漏
- 添加 `disconnected` 事件处理，自动重置会话状态
 2026-05-08 02:47:23 +08:00
sion123
a92379e20e feat(ui): 替换原生select为shadcn/ui组件并支持图片消息发送 
- 将 AccountBasicTab 和 ConfigForm 中的原生 select 替换为 shadcn/ui Select 组件
- ChatInput 支持拖放上传图片附件
- 添加 attachment button 并整合图片附件到消息发送
- 优化 Select 组件样式，增加过渡动画和悬停效果
- 调整 ConfigForm tab 切换样式为按钮风格
- AssetGallery 使用 useAccounts hook 获取账户列表
- 重新构建前端静态资源
 2026-05-08 02:29:07 +08:00
sion123
2186b04675 feat(web): 将原生 select 替换为 shadcn/ui Select 组件并支持图片消息发送 
- 在 AccountForm、AssetGallery、ChatView、ConfigForm、PromptEditor 中将 `<select>` 替换为 shadcn/ui 的 Select 组件以统一 UI 风格
- 在 ChatView 和 useChat hook 中支持发送图片附件
- 更新 pi-bridge 和 ws/chat 以处理 agent 调用中的图片数据
 2026-05-08 02:18:50 +08:00
sion123
803b55605f feat(agent): 支持工具执行结果中的图片和视频资产预览 
在聊天消息组件中添加资产灯箱预览功能，支持展示工具调用返回的图片和视频资源。新增 `AssetLightbox` 组件用于全屏浏览资产，并扩展消息类型以包含资产元数据。同时引入 `@radix-ui/react-select` 依赖并为服务端添加资产 URL 转换工具函数。
 2026-05-08 02:14:28 +08:00
sion123
e16305840b feat(agent): 添加视频创作工作流技能系统和流程工具 
新增基于 SKILL.md 的视频创作工作流系统，Agent 可通过 skills 目录加载结构化的导演指令；实现 validate_storyboard、update_manifest_items、confirm_images 三个流程工具支撑分镜校验、提示词更新和图片确认。
 2026-05-08 01:54:04 +08:00
sion123
3a124f0310 feat(web): 添加pi-coding-agent依赖包 2026-05-08 01:48:35 +08:00
sion123
2db7f316f2 chore(web): 将项目切换到ESM模块系统 
将项目从CommonJS切换到ESM模块系统，更新了`dev:server`和`db:init`脚本以使用`node --import tsx/esm`模式，并在`package.json`中添加了`"type": "module"`配置。
 2026-05-08 01:43:49 +08:00
sion123
a6f2973f21 refactor(agent): 迁移AI会话引擎至pi-agent-core库 
将原有基于Anthropic/OpenAI SDK的直播聊天代理重构为使用`@earendil-works/pi-agent-core`和`@earendil-works/pi-ai`库的统一API。

新增pi-bridge、pi-model、pi-persist、pi-tools四个模块，封装Agent路由、模型配置、消息持久化和工具适配逻辑。移除`chat.ts`中大量死代码，简化WebSocket处理流程。

BREAKING CHANGE: 移除`VideoAgent`类的`getAnthropicClient`、`getOpenAIClient`、`executeTool`等方法，外部调用需迁移至新pi-bridge API。`PROJECT_ROOT`路径计算方式变更，从`../../..`变为`../../`。
 2026-05-08 01:43:33 +08:00
sion123
2ab5396461 refactor(agent): 将 tools 模块拆分为独立文件并优化导入路径 
将 `tools.ts` 拆分为按功能划分的独立文件，并存放于 `tools/` 目录下，同时更新导入路径；优化 agent 系统提示语，移除冗余的「美图 Agent」前缀。
 2026-05-08 01:05:37 +08:00
sion123
10f11189f8 feat(web): 重构对话列表和资产页面，添加加载骨架屏和确认对话框 
- 重构 MiddlePanel 对话列表，按时间分组并优化交互
- 为 AccountList 和 AssetGallery 添加加载骨架屏
- 用确认对话框替换原生 confirm，统一交互体验
- 优化聊天消息组件的视觉样式和细节
- 添加 Escape 键快速返回账户列表导航
- 更新构建资源文件
 2026-05-08 00:53:34 +08:00
sion123
0fb33b9f57 feat(web): 重构组件样式并添加确认对话框组件 
- 优化组件视觉风格: 使用渐变色、阴影和圆角增强现代感
- 添加 ConfirmDialog 组件和 useConfirm hook 用于确认操作
- 改进聊天界面: 添加滚动到底部按钮、斜杠命令自动弹出
- 统一组件间距和颜色方案，提升 UI 一致性
 2026-05-08 00:41:09 +08:00
sion123
66d170066a feat(web): 添加全局 Toast 通知系统和资产预览导航功能 
- 新增 ToastProvider 和 useToast hook，支持全局成功/错误/信息提示
- 资产预览增加左右导航按钮、键盘快捷键(方向键)和计数器显示
- 资产库增加图片/视频类型筛选标签页及计数
- 对话列表增加最近对话展示、搜索优化和删除确认
- 消息增加删除确认对话框
- 优化聊天自动滚动行为，仅在用户未手动滚动时跟随新内容
- 新增删除消息 API 端点
- 优化消息历史清理逻辑，过滤错误消息和孤儿 tool 消息
- 添加自定义滚动条样式
- 优化账户参考图显示逻辑，支持本地文件显示
- 修复对话创建流程，直接导航到新创建的对话
 2026-05-08 00:23:36 +08:00
sion123
088bdb9a8e feat(web): 重构前端UI并支持OpenAI协议 
- 添加账号管理详情页（基本信息、提示词、CapCut、参考图标签页）
- 重构资产页面，按项目组分开展示图片/视频
- 聊天界面支持深度思考内容折叠展示、复制、删除消息
- 设置页面支持Agent配置（Anthropic/OpenAI协议）和工具配置
- 后端支持OpenAI兼容协议流式输出和DeepSeek思考模式
- 添加对话置顶/删除功能、数据库迁移、资产清单API
- 添加账号参考图上传/删除、技能配置持久化、连接测试API
 2026-05-07 23:48:26 +08:00
sion123
01963aac96 feat(web): add image/video generation and manifest tools to agent 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 04:17:54 +08:00
sion123
5104bbc18a feat(web): modernize chat UI, fix account navigation 
- Chat: avatars, cleaner bubbles, improved spacing, typing dots
- Input: rounded design, auto-expand textarea, arrow button, slash commands
- Account list: fix navigation with useParams reactivity
- Bot/User role labels in messages

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 04:14:16 +08:00
sion123
e850613972 feat(web): add markdown syntax highlighting, slash commands, stop button, quote/reply 
- PromptEditor with Prism.js syntax highlighting
- Slash commands (/run, /status, /images, /list, /help) in chat input
- Stop button to cancel ongoing generation
- Quote/reply and regenerate/continue actions in chat
- MiddlePanel with conversation timestamps and preview
- Pipeline progress in chat view
- Fix all remaining dark theme classes

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 04:09:00 +08:00
sion123
f43a640e64 fix(web): add conversation preview, fix dark theme remnants 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 04:07:46 +08:00
sion123
348cc0c5b9 refactor(web): router-based navigation, light theme, form config 
- Replace Zustand activeView with React Router (NavLink + Routes)
- White/light modern theme with indigo accents
- Sidebar with Chinese labels under icons
- ConfigForm with individual form fields (no JSON textareas)
- Account switching with context injection into chat
- Fix duplicate conversation creation with useRef guard
- Asset gallery: smaller 6-column grid with date labels
- All components updated to light color scheme

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 03:48:14 +08:00
sion123
2859fa3f2c fix(web): restructure client as standalone Vite project 
- client/ now has its own package.json (independent Vite project)
- Tailwind + PostCSS config inlined into vite.config.ts
- dev:client uses `cd client && npm run dev` (CWD = Vite root)
- Root package.json only has server deps
- Fix tsconfig deprecation (remove baseUrl)
- Add `npm run setup` for one-command install

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 03:36:22 +08:00
sion123
c257dd2b8c fix(web): change port to 3007, add auto port cleanup, graceful error handling 2026-05-07 03:26:22 +08:00
sion123
001dbde9f4 feat(web): integrate Claude LLM streaming with markdown rendering 
- Add Anthropic SDK with DeepSeek-compatible API config
- Streaming tool-use loop in WebSocket chat handler
- GitHub-style markdown rendering with markdown-it
- Tool status indicators and thinking states in chat UI
- Fix Tailwind content path and CSS border utility

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 03:22:15 +08:00
sion123
d6b18fb7dc fix(web): add class-variance-authority dependency 2026-05-07 02:48:01 +08:00
sion123
1bad63ff6d feat(web): add conversation search, rename, and pipeline resume 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:46:29 +08:00
sion123
177c90a661 feat(web): add pipeline resume from conversation context 2026-05-07 02:46:16 +08:00
sion123
af6ea966fd feat(web): add asset gallery with waterfall layout, preview and delete 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:44:06 +08:00
sion123
685e383621 feat(web): add asset CRUD and scanning API 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:44:04 +08:00
sion123
6e3f5d9415 feat(web): add chat UI with WebSocket streaming and conversation persistence 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:41:01 +08:00
sion123
10685ea866 feat(web): add pipeline progress inline component 2026-05-07 02:38:38 +08:00
sion123
375540f528 feat(web): add WebSocket chat handler with message persistence 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:36:42 +08:00
sion123
19a1a4e6d2 feat(web): add pi-agent tool layer with pipeline integration 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:36:28 +08:00
sion123
e35778ebea feat(web): add prompt editor with split-pane and Markdown editing 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:34:04 +08:00
sion123
66f0f82fde feat(web): add prompt file read/write API 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:32:50 +08:00
sion123
c9fe380d0d feat(web): add account list and form components 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:30:32 +08:00
sion123
93e67bb8dc feat(web): add settings config form 2026-05-07 02:29:31 +08:00
sion123
63e619bb92 feat(web): add config CRUD API routes 2026-05-07 02:27:18 +08:00
sion123
c27bd54bb3 feat(web): add account CRUD API routes 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:27:09 +08:00
sion123
8b11383bc4 feat(web): add typed API client 2026-05-07 02:27:01 +08:00
sion123
58ceb0af00 feat(web): add three-column layout shell with placeholder views 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:24:43 +08:00
sion123
0c8283d6e9 feat(web): add SQLite schema and connection 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:21:49 +08:00
sion123
d63ecd8d29 feat(web): add shadcn/ui base components (Button, Input, ScrollArea) 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:21:21 +08:00
sion123
5263fcd571 feat(web): add Express + WebSocket server entry 2026-05-07 02:20:49 +08:00
sion123
fa8bfde952 feat(web): init Vite + React + Tailwind client scaffold 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:18:36 +08:00
sion123
380df630ec feat(web): init project scaffold with package.json and tsconfig 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:16:46 +08:00
sion123
e848f32a11 docs: 美图 Agent 视频创作界面实施计划 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:12:55 +08:00
sion123
b230a418a7 docs: 美图 Agent 可视化界面设计文档 
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-07 02:01:34 +08:00
sion123
4e03ed7197 docs: 精简和清理提示词文档内容 
清理了提示词文档中不必要的冗余内容，删除了重复的描述和示例，使文档更加简洁清晰。
 2026-05-07 01:31:56 +08:00
sion123
fb962ba919 docs: 精简和清理提示词文档内容 
此次更改主要清理和简化了多个提示词文档，包括分镜提示词、角色提示词和通用提示词文件：
- 移除冗余描述和示例
- 统一各文档的格式和结构
- 简化表达，提高可读性
 2026-05-07 01:08:29 +08:00