Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Posts
Notes of novel view synthesis
Published:
CamCo
- 研究背景与主要贡献： 目前视频扩散模型已经成为能够生成高质量视频内容的生成式工具被广大用户使用。但是这些模型大多都不能提供精准的相机位姿控制，就给电影语言的表达带来了限制。为了解决这个问题，提出了CamCo，能够允许细粒度的相机位姿控制为image-to-video 生成。 ① 使用Plucker 坐标表示准确的参数化的相机位姿输入，equip在预训练的image-to-video 生成器中 ② 加强3d一致性，使用了一个极线注意力模块，加强feature maps的极限约束 ③ 在真实世界视屏上微调CamCO，通过structure-from-motion算法
- 技术与方法论： corresponding ①： 基于Stable Video Diffusion模型训练了CamCo，SVD difffusion model学习逐步的降低高方差高斯噪声。作者通过light field network 和plucker 坐标收到启发，使用坐标来表示相机的内参和外参。 为了融合相机embeddings, 我们在预训练的视屏生成器中的每一个temporal attention block加入了简单的adapter layer。在每个tempal attention block 中，首先concatenate plucker coordinates 和network feature 在channel dimension上，然后将他们传出1*1的卷积层中去project back 到原始的特征空间。 corresponding ②： 构建了Epipolar Constraint Attention，引入极线约束 corresponding ③： 由于缺乏动态场景的训练数据，模型很容易在静态场景下出现过拟合，只能有很少一部分的物体运动。 增强训练数据集+管理高质量样例
portfolio
Portfolio item number 1
Short description of portfolio item number 1
Portfolio item number 2
Short description of portfolio item number 2
publications
Paper Title Number 1
Published in Journal 1, 2009
This paper is about the number 1. The number 2 is left for future work.
Recommended citation: Your Name, You. (2009). "Paper Title Number 1." Journal 1. 1(1).
Download Paper | Download Slides
Paper Title Number 2
Published in Journal 1, 2010
This paper is about the number 2. The number 3 is left for future work.
Recommended citation: Your Name, You. (2010). "Paper Title Number 2." Journal 1. 1(2).
Download Paper | Download Slides
Paper Title Number 3
Published in Journal 1, 2015
This paper is about the number 3. The number 4 is left for future work.
Recommended citation: Your Name, You. (2015). "Paper Title Number 3." Journal 1. 1(3).
Download Paper | Download Slides
Paper Title Number 4
Published in GitHub Journal of Bugs, 2024
This paper is about fixing template issue #693.
Recommended citation: Your Name, You. (2024). "Paper Title Number 3." GitHub Journal of Bugs. 1(3).
Download Paper
talks
Talk 1 on Relevant Topic in Your Field
Published:
This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Conference Proceeding talk 3 on Relevant Topic in Your Field
Published:
This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.