About OpenTech.News
Tech Stack
Data sources
- Topic-specific Google News RSS feeds
- Examples: "PostgreSQL", "Supabase", "FastAPI"
- Discourse Forum "Top Weekly RSS feeds (soon)
- Example: Python, Django, Maker Forums, Austin ASMBLY Maker-space
- GitHub Discussion forum ATOM feeds (soon)
Story fetcher
- We use Python and Feedparser to get the stories RSS/ATOM feeds.
- The stories are loaded into a cloud-hosted PostgreSQL database using Supabase
Page builder
- We use Python, Supabase, and Jinja to query the database and save it as Markdown & HTML files
- Next, we use MkDocs static-site generator + MkDocs-Material theme to convert the topic-specific Markdown files into an HTML site
Hosting & Serving
- We use Amazon Web services (AWS) as the platform to store and serve the website.
- The static HTML site generated by MkDocs is uploaded to AWS S3 cloud storage using
aws s3 sync - AWS CloudFront caches, distributed, and serves the HTML content to end-users
Automated publishing
- Use currently use Debian Linux + Cron scheduler to
- Fetch new stories (every minute)
- Build the HTML site (every minute)
- Upload to AWS S3 storage (every minute)
Code repository
- We use Codeberg to host the code repository (similar to GitHub)
Want to join the fun?
You're invited! Let's code jam.