DEV Community

Bernd Ruecker
Bernd Ruecker

Posted on • Originally published at blog.bernd-ruecker.com on

How we ran a successful virtual conference with > 6500 attendees

Due to COVID-19 we had to switch CamundaCon New York to CamundaCon Live on very short notice. It was a great success!

We planned to hold CamundaCon in New York City at the end of April. Due to COVID-19 we had to cancel, but we still wanted to hold an event for the community. So last week we ran CamundaCon Live and it was a huge success.

I asked a lot of people about their experiences with virtual conferences beforehand and promised to write a quick recap of how we did afterward. Here it is.

TL-DR

  • Using On24 with live talks+ Slack
  • 2 days, 2 tracks, 2 panels, 5 keynotes, 15 other sessions
  • US east coast friendly time (10am — 4pm EST = 4pm — 10pm CEST)
  • 6530 registered participants; 2995 unique attendees; 1214 people joined the Slack channel

Sandy Kemsley actually made a great summary of how we ran our conference in her blog:

I mentioned on Twitter today that CamundaCon is now the gold standard for online conferences: all you other vendors who have conferences coming up, take note. I believe that the key contributers to this success are live (not pre-recorded) presentations, use of a discussion platform like Slack or Discord alongside the broadcast platform, full engagement of a large number of company participants in the discussion platform before/during/after presentations, and fast upload of the videos for on-demand watching. Keep in mind that a successful conference, whether in-person or online, allows people to have unscripted interactions: it’s not a one-way broadcast, it’s a big messy collaborative conversation.

Tool Requirements

It was actually a bit disillusioning to check existing tooling. Even in 2020 virtual conferences are still a huge challenge. We wanted to:

  • Stream talks live in two different tracks. Switching the tracks should be easy for the audience.
  • Have slides and webcam for every presenter.
  • Have all talks recorded and available on-demand soon after being live.
  • Work without technical glitches, for an audience > 5000 people.
  • Create some way the attendees could engage, to make it feel more like a conference than a super long series of webinars.

Engagement

Out of that list, especially engagement is a big challenge. For the speaker, it is already hard to not have visual feedback. But how can you keep an audience engaged when you’re just showing videos for hours? Where is the advantage over a YouTube playlist?

And this is the hard part when it comes to virtual conferences. I see different strategies applied:

  • Some conferences (e.g. CyberLand in Germany) did rely on the question tool of the webinar software but had a moderator ready to repeat questions to the speaker at the end of the talk. They made sure to have an extra hour available for questions after the talk (which means for attendees they might miss the next talk).
  • Some conferences switch to recorded talks but with a live Q&A, for example, I will talk at AWS Community Summit Online in May doing so.
  • Some conferences have their own channels open for questions and discussions. This is different to just ask questions into the ether (the webinar QA tool) as you can really discuss with others and follow-up on discussions after the talk.

We decided to create our own Slack channel. It turned out to be a huge success. Around 1,200 attendees, out of 6,500 registered participants joined and there were constant discussions going on. There was a dedicated #community-projects and #ask-the-experts channel available, where all Camunda people hung out and answered any question in a couple of minutes.

There was one channel for every track where questions and discussions around the talks happened. And there was a #general channel where hundreds of people said hello and actually shared their selfie attending Camunda Con. Given that most of them are in their private home offices at the moment, sharing this involves quite a bit of trust. But it did make a huge difference to feeling like you were really attending a conference at that moment — something you could never achieve with pure recordings.

Slack worked quite well for us (even if we are now close to the 10,000 message mark where you either pay or lose history). You can also use direct messages to talk to other attendees (e.g. because they asked some interesting questions) or could even jump in a breakout room (video call on slack). And we also had quite some fun internally to moderate — as the level of engagement made it really enjoyable as you can easily see from our internal channel:

I am happy that we did not try to do CamundaCon without it.

I heard other conferences using Discordfor this matter successfully.

Live Talks vs. Recordings

For this decision, you typically weigh the advantage of having a live feeling with the effort and risk (what could possibly go wrong?).

We actually wanted to do live sessions as much as possible, but we asked every speaker if they are OK with that. In the end, only two talks were pre-recorded, one with a very remarkable reason: The speaker had his last university exam on that day and was not sure if he can make it on time for his talk :-) For some other talks we had mp4 recordings available as a fallback but did not need to use it.

We did not experience a lot of technical glitches, only one talk was stopped abruptly because the speaker got disconnected. And in one of the panel discussions, one panelist had to rejoin via phone.

I think these obstacles were worth the gain. I can’t explain why, but a live talk feels much better. It motivates me to join. A recording is more patient, I can also watch it in 10 minutes. Hang, on, there is this thing. Let’s do it later. Or tomorrow. Well, never. This also kills the live comments and discussions on Slack easily.

Earlier this month I talked at AllTheTalks, which was awesome by the way. They also had mostly live talks, but also a couple of recordings. It was interesting to see for myself, that I was not really motivated to watch the recorded ones. But maybe that’s different for other people?

Tooling

Let’s talk about tooling. There is some huge opportunity for a good virtual conference tooling to hit the market right now. So far, I haven’t seen the perfect solution. This is what we looked at:

  • On24(which is what we went with): This is a proven live event platform. The speaker UI isn’t super great but did work in the end for all of the speakers. The attendee experience is actually pretty OK and better than what we have seen with other tools. We trusted their ability to serve the number of attendees we expected.
  • Hopin.to: I heard of this tool from a couple of people, but it is pretty new and I did not even manage to get preview access. The upcoming MicroXchgwill use it and I am looking forward to testing the experience.
  • Twitch.tv: Being kind of the nerd-internet-TV, twitch can be leveraged for live conferences (I personally will see that happening with AWS Community Summit).
  • Webinar tools like GotoWebinar, BigMarker, Zoom Webinars, Adobe Connect, Google Meet.
  • Other tools I saw being used (but we have not investigated further): https://socio.events/, https://www.cube365.net/

Some back end considerations that our marketing kept in mind when considering the platforms:

  • Single sign-up experience. We did not want users to register for 20+ sessions separately.
  • Support for pre-registration. We had to start promoting the event before we even had the platform. So pre-registered users would need to be imported without having to re-register.
  • Integration with our CRM tools.
  • Analytics (e.g. around registered vs. attended by session)
  • Onboarding and event support within a super short time frame.
  • Own event webpage provided by the tool to save effort on our side.

In the end, ON24 cut it and we were happy with it.

Moderation And Support

There was a lot of work done in the background that you hardly see. Every track had a producer, that verified the tooling worked well. Every session had a support person from On24 joining to sort out any issues.

One more visible aspect was a very important one for the experience: the moderators. Every track had its own video/session moderator as well as a Slack moderator assigned. The video moderator did not only announce the speaker but also had a look at the questions (in On24 and Slack) and thus could moderate the Q&A at the end of the talk. This is a must-have.

The additional Slack moderators made sure that questions in Slack were addressed often directly during the talk and afterward. They also made sure to motivate people to ask questions.

And as you can see with my colleague Niall — moderating can also be quite fun and helps keeping people engaged ;-)

Smaller Conferences And Meetups

I want to add that we ran a relatively big conference. If you have smaller conferences or probably meetups with around up to 100 or 200 attendees, I also saw simple video conferencing options work very well, this includes:

  • Zoom, seen in the wild at a couple of meetups up to 100 people very successfully been used. Make sure you apply some best practices around security to avoid spam or people taking over your screensharing.
  • Videofacilitatoras it was used by Agile Cologne.
  • BlueJeans, SendBird, or others.

Some Numbers And Feedback

Here are some interesting stats we gathered:

  • 6530 Registered Users
  • 2995 Unique Attendees (45.8%)
  • Live Attendees/session: 809
  • Largest session: 1732 live attendees (2070 registrations)
  • Average sessions attended: 7 sessions
  • Average time (minutes): 181 minutes
  • Questions asked: 407 questions
  • 8960 hours of content consumed

And we got super positive feedback:

Now — can It Replace an In-person Conference?

To make sure: I just describe my personal gut feeling here. Whatever I say is not a decision of Camunda. Actually, when it comes to deciding about CamundaCon it is the call of our great marketing folks, together with our epic developer relations team, not me!

That’s said, I think it was a great experience and there is definitely a big upside in doing CamundaCon as a virtual conference. We had a much bigger outreach. We had more attendees than we would have had in New York. People joined from all over the world, sometimes in the middle of the night.

And this is actually a big pro-argument: This way of running a conference makes it so much easier for everybody to join, independent of their location, budget, travel constraints or the like. And I got the impression that some people even engaged better on Slack more that they would have in-person.

So, yes, I think it would be great to keep running virtual conferences in the future!

But of course, there are downsides as well. You simply do not meet people in person, which is still a very different experience. I made so many friends at conferences over the years, which would not have happened virtually. And our salespeople or consultants typically meet with a lot of prospects, which allows building a more trusted relationship on a personal level, which is really hard to replace. Also, it gets much more tiring to sit in front of your computer the whole day, probably with your kids disturbing you every other hour.

So, no, I don’t think virtual conferences can replace in-person events!

So I am still curious myself, what strategy we come up with for CamundaCon in the future — but I totally trust our world-class team to make the right decision.

A very last remark: Note that we are doing a vendor conference. We don’t do conferences to earn money, but to get the community together and foster knowledge sharing. So we don’t mind that we do the conference for free and can’t sell any sponsoring packages. Incoming money for in-person conferences is directly routed to venue and catering anyway. But this is a whole different story for professional conference organizers that need to earn their money. I think, going virtual is not really an option for them.

Conclusion

CamundaCon live was a lot of fun and a huge success. I can just motivate everybody to run a virtual conference. Aim for live talks and a good engagement channel on the side. On24 and Slack served us well.

Don’t underestimate the amount of effort that goes into the organization. We had a lot of people working enthusiastically behind the scenes to make it happen. Thank you all folks — you are truly awesome!


Bernd Ruecker is co-founder and chief technologist of Camunda. He likes speaking about himself in the third-person. He is passionate about developer-friendly workflow automation technology. Connect via LinkedIn or follow him on Twitter. As always, he loves getting your feedback. Comment below or send him an email.

Top comments (0)