We shipped a new feature which allows you to automatically generate and maintain a statically-hosted blog from your DEV posts. This effectively makes DEV a headless CMS for your own hosted sites.
You can already cross-post to DEV from your RSS feed, but this flips the model and presents some fascinating possibilities.
This is a collaboration with Stackbit, who specializes in the generation of static sites. They represent the first Oauth application that hooks into our platform, and we look forward to generalizing this feature for future collaborations.
Stackbit integrates with services like GitHub pages for storing the static files and Netlify for serving. It also allows you to choose between static site generators like Gatsby, Jekyll and Hugo. The whole process is magical.
Here is my generated site: https://royal-lime-c9165.netlify.com π
And here is the repo where all the static content lives, generated automatically with a couple clicks, but editable thereafter to my heart's content...
Stackbit Fresh Theme
This site was generated by www.stackbit.com, v0.2.73.
Running Your Site Locally
-
get "stackbit-api-key" from project menu in Stackbit dashboard
-
run the following command to assign this key to
STACKBIT_API_KEYenvironment variable:export STACKBIT_API_KEY={stackbit_netlify_api_key} -
run the following command to fetch additional site contents from Stackbit if needed:
npx @stackbit/stackbit-pull --stackbit-pull-api-url=https://api.stackbit.com/pull/5d8c91658876b300134349f5 -
Build the site and start the Hugo server with drafts enabled
hugo server -D -
Browse to http://localhost:1313/
π View a Step-by-step guide on getting started
Why would I want to do this?
That's a good question.
For us, the founders of DEV, we consider it critical that we provide tooling to help folks better manage their data and online presence. We want to be a destination for sharing, teaching, discussing, and generally uplifting one another with our writing, but we don't want to monopolize this game.
There are a lot of reasons to be a part of the DEV ecosystem, but we don't want to make it hard to leave if you ever wanted to. Maintaining a mirror of your DEV content which you can syndicate here and elsewhere is a component of keeping web content from being wholly consumed by centralized monolithic platforms.
I wrote more about these ideas here:
And for a bit of extra info about our ethos and outlook, here's another relevant post from a few months back...
DEV is about a lot more than just blogging, so these generated sites are necessarily lacking. There's a reason we congregate here, but we firmly believe that a healthy ecosystem is one where personal website still have a place, and migrating platforms is made as simple as possible.
You do not need to be crossposting to a personal site. In fact, there are a lot of good reasons to centralize traffic to a destination like this where you can build up followers and gather reputation. But still, there may come a time where you want your content driven by your personal site.
We are on day one of this functionality. There may be some additional configuration required to get it just right so please view this as an exciting proof of concept, rather than entirely fleshed out feature. And if you encounter edge cases that break the functionality, let us know via an issue...
Forem π±
Welcome to the Forem codebase, the platform that powers dev.to. We are so excited to have you. With your help, we can build out Foremβs usability, scalability, and stability to better serve our communities.
What is Forem?
Forem is open source software for building communities. Communities for your peers, customers, fanbases, families, friends, and any other time and space where people need to come together to be part of a collective See our announcement post for a high-level overview of what Forem is.
dev.to (or just DEV) is hosted by Forem. It is a community of software developers who write articles, take part in discussions, and build their professional profiles. We value supportive and constructive dialogue in the pursuit of great code and career growth for all members. The ecosystem spans from beginner to advanced developers, and all are welcome to find their placeβ¦
If it's on the Stackbit side, we'll pass on the info for you.
The technical details
DEV uses markdown and is generally compatible with other markdown-driven frameworks. As you can see from the above GitHub repo, we do have custom rich content which does not render uniformly like markdown to HTML. Stackbit transforms this rich content into iframe, whereas we display this stuff inline via plain old HTML.
Stackbit acts as convenient and powerful piping, but has minimal lock-in because it integrates with other services and generates standard open source projects. This gives you a lot of additional freedom to break from the ecosystem.
This is an area where centralization of rendering control has efficiencies which are hard to replicate with this kind of thing, but it's a small detail compared with the overall positive benefits of this optionality for everyone.
It is possible that the implementation of this could change over time, depending on what ideas we all come up with together.
Going forward
In the future...
- The functionality and config of this feature and similar ones will evolve to be more and more useful over time.
- More apps will be allowed to build on our Oauth functionality. Feel free to contribute to the generalization of this feature via our repo.
- We will launch more and more functionality devoted to transparency, data portability, and decentralization. We have a lot of big things coming.
If you want to get involved in any of our open source plans, Hacktoberfest is going to be the best time to do it...
Register for Hacktoberfest. We'll have lots of new guiding contribution material ready for the beginning of the celebration on October 1st.
In case you skimmed past it above, here are the instructions to get started with Stackbit.
Happy coding!
Top comments (75)
We also just launched on product hunt if you want to see some pretty screenshots of the generated sites π
producthunt.com/posts/dev-stackbit
(we should probably add a product hunt liquid tag, right?!)
Some of the touches on Stackbit are so much more clean and beautiful than anything we produce here at DEV π
I hope soon enough we'll smooth out the details of our experience in the little ways like this. (If anybody knows a great designer DM me π)
But this also speaks to our ongoing interest in having underlying core mechanics that enable the correct behavior that our place in the ecosystem deserves... rather than focusing too heavily on the beautiful outer crust.
Compatibility with markdown and static site generators, a programmable API, ample tooling for data export, underlying follow mechanics and feed control that help folks control their experience... I'm proud that we find a way to prioritize the important, less visible stuff. I think it's paying off a lot lately.
This is amazing! It seems like it will save a bunch of time/hassle for setting up new blogs and hosting of content.
Congrats on launching it! π
Any word about how this impacts SEO / changes how google looks at your own personal site? I'm not great with that stuff π
I was wondering if I'd have to go in and add canonical tags, or are they added automagically? AND if they are added, which site is considered canonical?
This is it. I was wondering why are you pushing a repo in each hour π€
Awesome feature! π
Launch day... Always one more thing that we forgot π
We all have been there π
I guess you need to enable canonical URLs on your new website.
I checked your site and while this blog: royal-lime-c9165.netlify.com/posts...
doesn't have any canonical URL - it could potentially be marked as duplicate content because it's also hosted on: dev.to/devteam/you-can-now-generat...
It is possible to add canonical tags to your DEV.to post. Bit annoying to go through posts and adjust them but it should solve the problem.
I meant that if you look at the site that Ben's created - it doesn't have any canonical URL which is not good for SEO since Google could flag the content as duplicate!
Absolutely! But did he have a canonical URL front matter in his dev.to blog post?
I'm going to experiment a bit.
No, but it means that the original content is assumed to be from dev.to and not from anywhere else.
Whereas when Google will crawl the Netlify website, it will likely treat the content as duplicate from the dev.to blog
Weβre working on better support for canonical URLs. Itβs a matter of settling on how the configuration will work on the DEV side.
Itβs been discussed, but we pushed it until post-release because we wanted some broader usability feedback.
Thank you for this answer!
It'd be great if the process could add the canonical URLs to the dev.to posts automatically.
This would allow org devs to post on dev.to and then generate a standalone site which appears to have the orig content, with the dev posts pointing to it. Is that currently possible (without adding the canonical urls manually)?
So this is amazingly appealing for sure. My biggest question at this point is who owns the data? Is there an easy export of all my markdown?
The data generated in this feature will land in a GitHub repo for you do do what you want with it.
Additionally on this topic, but unrelated to the feature, you can export your data from the
Export Contentarea of dev.to/settings/miscGlad you like it π
Where exactly is the data in the Github repo? I created a quick test and I don't see my posts anywhere. Just curious because I want to write an article/post a video on this and I am sure this is going to come up.
did you get an answer to this question ?
I signed up on here a few minutes ago because I just wanted to quickly comment on another article. And now I'm sitting here and discover what a wonderful philosophy is behind dev.to.
My reluctance with publishing on Medium had always been that they basically own your content and it will go down together with them. However, if you want others to find your content, it definitely helps to use a platform instead of a personal blog.
Dev.to seems to be a healthy middle-ground between discoverability and data-ownership. Nice. ππ»
That is great. This is what I somehow manually did with my Gatsby portfolio using the rss feed. For sure it makes it so much easier now
Nice!
This is pretty awesome!
Does it allow me to publish on the self-hosted site first and then on dev.to later?
That use case isn't 100% cleanly supported with this integration alone, though we'll work to make it function as expected.
I am pretty sure you could rig that up right now via this feature and some work with our API. We'll work to tie it all up nicely soon enough.
Cool.
Would be nice if this could be configured via publish dates in the front matter.
Some of us may feel the need to express ourselves in mathjax. I wonder if this feature can be supported at least on a per-post basis?
If so, this would be a great solution to deploy to my personal website as well :)