We shipped a new feature which allows you to automatically generate and maintain a statically-hosted blog from your DEV posts. This effectively makes DEV a headless CMS for your own hosted sites.
You can already cross-post to DEV from your RSS feed, but this flips the model and presents some fascinating possibilities.
This is a collaboration with Stackbit, who specializes in the generation of static sites. They represent the first Oauth application that hooks into our platform, and we look forward to generalizing this feature for future collaborations.
Stackbit integrates with services like GitHub pages for storing the static files and Netlify for serving. It also allows you to choose between static site generators like Gatsby, Jekyll and Hugo. The whole process is magical.
Here is my generated site: https://royal-lime-c9165.netlify.com π
And here is the repo where all the static content lives, generated automatically with a couple clicks, but editable thereafter to my heart's content...
Stackbit Fresh Theme
This site was generated by www.stackbit.com, v0.2.73.
Running Your Site Locally
-
get "stackbit-api-key" from project menu in Stackbit dashboard
-
run the following command to assign this key to
STACKBIT_API_KEYenvironment variable:export STACKBIT_API_KEY={stackbit_netlify_api_key} -
run the following command to fetch additional site contents from Stackbit if needed:
npx @stackbit/stackbit-pull --stackbit-pull-api-url=https://api.stackbit.com/pull/5d8c91658876b300134349f5 -
Build the site and start the Hugo server with drafts enabled
hugo server -D -
Browse to http://localhost:1313/
π View a Step-by-step guide on getting started
Why would I want to do this?
That's a good question.
For us, the founders of DEV, we consider it critical that we provide tooling to help folks better manage their data and online presence. We want to be a destination for sharing, teaching, discussing, and generally uplifting one another with our writing, but we don't want to monopolize this game.
There are a lot of reasons to be a part of the DEV ecosystem, but we don't want to make it hard to leave if you ever wanted to. Maintaining a mirror of your DEV content which you can syndicate here and elsewhere is a component of keeping web content from being wholly consumed by centralized monolithic platforms.
I wrote more about these ideas here:
And for a bit of extra info about our ethos and outlook, here's another relevant post from a few months back...
DEV is about a lot more than just blogging, so these generated sites are necessarily lacking. There's a reason we congregate here, but we firmly believe that a healthy ecosystem is one where personal website still have a place, and migrating platforms is made as simple as possible.
You do not need to be crossposting to a personal site. In fact, there are a lot of good reasons to centralize traffic to a destination like this where you can build up followers and gather reputation. But still, there may come a time where you want your content driven by your personal site.
We are on day one of this functionality. There may be some additional configuration required to get it just right so please view this as an exciting proof of concept, rather than entirely fleshed out feature. And if you encounter edge cases that break the functionality, let us know via an issue...
Forem π±
Welcome to the Forem codebase, the platform that powers dev.to. We are so excited to have you. With your help, we can build out Foremβs usability, scalability, and stability to better serve our communities.
What is Forem?
Forem is open source software for building communities. Communities for your peers, customers, fanbases, families, friends, and any other time and space where people need to come together to be part of a collective See our announcement post for a high-level overview of what Forem is.
dev.to (or just DEV) is hosted by Forem. It is a community of software developers who write articles, take part in discussions, and build their professional profiles. We value supportive and constructive dialogue in the pursuit of great code and career growth for all members. The ecosystem spans from beginner to advanced developers, and all are welcome to find their placeβ¦
If it's on the Stackbit side, we'll pass on the info for you.
The technical details
DEV uses markdown and is generally compatible with other markdown-driven frameworks. As you can see from the above GitHub repo, we do have custom rich content which does not render uniformly like markdown to HTML. Stackbit transforms this rich content into iframe, whereas we display this stuff inline via plain old HTML.
Stackbit acts as convenient and powerful piping, but has minimal lock-in because it integrates with other services and generates standard open source projects. This gives you a lot of additional freedom to break from the ecosystem.
This is an area where centralization of rendering control has efficiencies which are hard to replicate with this kind of thing, but it's a small detail compared with the overall positive benefits of this optionality for everyone.
It is possible that the implementation of this could change over time, depending on what ideas we all come up with together.
Going forward
In the future...
- The functionality and config of this feature and similar ones will evolve to be more and more useful over time.
- More apps will be allowed to build on our Oauth functionality. Feel free to contribute to the generalization of this feature via our repo.
- We will launch more and more functionality devoted to transparency, data portability, and decentralization. We have a lot of big things coming.
If you want to get involved in any of our open source plans, Hacktoberfest is going to be the best time to do it...
Register for Hacktoberfest. We'll have lots of new guiding contribution material ready for the beginning of the celebration on October 1st.
In case you skimmed past it above, here are the instructions to get started with Stackbit.
Happy coding!
Oldest comments (75)
So this is amazingly appealing for sure. My biggest question at this point is who owns the data? Is there an easy export of all my markdown?
The data generated in this feature will land in a GitHub repo for you do do what you want with it.
Additionally on this topic, but unrelated to the feature, you can export your data from the
Export Contentarea of dev.to/settings/miscGlad you like it π
Where exactly is the data in the Github repo? I created a quick test and I don't see my posts anywhere. Just curious because I want to write an article/post a video on this and I am sure this is going to come up.
did you get an answer to this question ?
Would it be possible to auto add the generated static site as the canonical URL?
This is not yet available, but it will be at some point soon. We have a handful of configuration details we need to work out.
Iβd love to see a comment plugin for wordpress that allows the comments to be shared with the cross post in dev.to.
And it could be a potential revenue source for dev.to since comment plugins typically have a freemium model.
That's an interesting idea
This is it. I was wondering why are you pushing a repo in each hour π€
Awesome feature! π
Launch day... Always one more thing that we forgot π
We all have been there π
We also just launched on product hunt if you want to see some pretty screenshots of the generated sites π
producthunt.com/posts/dev-stackbit
(we should probably add a product hunt liquid tag, right?!)
That is great. This is what I somehow manually did with my Gatsby portfolio using the rss feed. For sure it makes it so much easier now
Nice!
Some of the touches on Stackbit are so much more clean and beautiful than anything we produce here at DEV π
I hope soon enough we'll smooth out the details of our experience in the little ways like this. (If anybody knows a great designer DM me π)
But this also speaks to our ongoing interest in having underlying core mechanics that enable the correct behavior that our place in the ecosystem deserves... rather than focusing too heavily on the beautiful outer crust.
Compatibility with markdown and static site generators, a programmable API, ample tooling for data export, underlying follow mechanics and feed control that help folks control their experience... I'm proud that we find a way to prioritize the important, less visible stuff. I think it's paying off a lot lately.
This is amazing! It seems like it will save a bunch of time/hassle for setting up new blogs and hosting of content.
Congrats on launching it! π
Any word about how this impacts SEO / changes how google looks at your own personal site? I'm not great with that stuff π
I was wondering if I'd have to go in and add canonical tags, or are they added automagically? AND if they are added, which site is considered canonical?
Connecting to dev.to seems to not be working at the moment. Im not sure I understand how this can be a headless cms if stackbit does not have a rest api that we can interface with?
We had a brief hug of death when this first went live but it's working now.
Via the integration, DEV sends webhooks on changes of content in order to keep sites updated, so there is an underlying API that powers this all.
This is pretty awesome!
Does it allow me to publish on the self-hosted site first and then on dev.to later?
That use case isn't 100% cleanly supported with this integration alone, though we'll work to make it function as expected.
I am pretty sure you could rig that up right now via this feature and some work with our API. We'll work to tie it all up nicely soon enough.
Cool.
Would be nice if this could be configured via publish dates in the front matter.
So how will this work with canonical URLs? Does it automatically link to the newly generated site or is that something that needs to be done manually?
Does it work with github.com/JavaEden/Orchid ?
I don't see Orchid in the dashboard, but maybe @ohadpr can weigh in on whether it is in the works.
Orchid isn't supported yet but soon folks will be able to contribute their own themes to build their DEV sites with and user any static site generator.
It would be amazing to get Orchid integrated into the Stackbit platform! I'm the developer behind Orchid, and I'd love to work with y'all to get Orchid supported by Stackbit. What would it take to get Orchid supported?
Orchid is still pretty new/small so I wouldn't expect it to be natively supported by most JAMstack tooling.
That said, connecting DEV as a headless CMS to Orchid natively shouldn't be too difficult, I've already been experimenting with this kind of abstraction with the wiki and shouldn't take too much work to get it supported for blog posts too.
This is amazing. Well done
Thanks Thanks Thanks. This is exactly what I wanted sometime back.
This is awesome!! I wish I could post the dancing banana for this.