Comments (1)
先说明一下现在的状况:
- text UI, image UI, pages UI, three-columns UI , feeds 的当天的内容都是直接向日报发请求,然后加个缓存。three-colums UI 还会通过 AJAX 请求你选择的文章的内容。
- 各个 UI 当天之前的日报都是直接从数据库中取的。
fetch_data.py
设置个 cron 定时任务,每天取抓取上一天的内容。
总结一下就是,当天的日报是直接向日报发请求的,当天之前的是从数据库取。这样的做的原因,可能是由于早先时候的设计比较简单,是没有数据库使用的。但直接发请求的服务稳定性不好,日报 API 跪我这边就跪了,而且响应时间其实有点长。
现在的想法是,数据抓取方面的事务都交由 fetch_data.py
处理,而视图方面则统一从数据库里取。
from zhihudaily.
Related Issues (20)
- Maybe add a middleware HOT 1
- Add log
- Organize the code
- Redesign the caching system HOT 1
- 三栏 UI 下,ajax 的链接位置不合适 HOT 2
- Redesign the UI v1 HOT 1
- Try new relic, sentry, ansible...
- Add robots.txt HOT 3
- Use database.
- Refactor fetch_data.py
- Wrong cache behaviour: /before/<date> HOT 1
- Refactor zhihudaily v2
- date in the database schema HOT 2
- Add tests
- Make it faster HOT 1
- Speed up loading bootstrap static files. HOT 2
- When manually input the date that it doesn't exist in our database.
- 图片 UI 和分页 UI 下,图片未使用 HTTPS
- ideas
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zhihudaily.