Startup makes meeting data searchable and shareable, and automates data entry into workplace apps.
The startup Fireflies.ai is helping people get the most out of their meetings with a note-taking, information-organizing virtual assistant named Fred.
Image courtesy of the researchers
Many decisions are made and details sorted out in a productive business meeting. But in order for that meeting to translate into results, participants have to remember all those details, understand their assignments, and follow through on commitments.
The startup Fireflies.ai is helping people get the most out of their meetings with a note-taking, information-organizing virtual assistant named Fred. Fred transcribes every word of meetings and then uses artificial intelligence to help people sort and share that information later on.
"There's a tremendous amount of data generated in meetings that can help your team stay on the same page," says Sam Udotong '16, who founded the company with Krish Ramineni in 2014. "We let people capture that data, search through it, and then share it to the places that matter most."
The tool integrates with popular meeting and scheduling software like Zoom and Google Calendar so users can quickly add Fred to calls. It also works with collaboration platforms like Slack and customer management software like Salesforce to help ensure plans turn into coordinated action.
Fireflies is used by people working in roles including sales, recruiting, and product management. They can use the service to automate project management tasks, screen candidates, and manage internal team communications.
In the last few months, driven in part by the Covid-19 pandemic, Fred has sat through millions of minutes of meetings involving more than half a million people. And the founders believe Fred can do more than simply help people adjust to remote work; it can also help them collaborate more effectively than ever before.
"[Fred] is giving you perfect memory," says Udotong, who serves as Firelies' chief technology officer. "The dream is for everyone to have perfect recall and make all their decisions based on the right information. So being able to search back to exact points in conversation and remember that is powerful. People have told us it makes them look smarter in front of clients."
Taking the leap
Udotong was introduced to the power of machine learning in his first year at MIT while working on a project in which students built a drone that could lead people on campus tours. Later, during his first MIT hackathon, he sought to use machine learning in a cryptography solution. That's when he met Ramineni, who was a student at the University of Pennsylvania. That's also when Fireflies was born - although the founders would go on to change everything about the company besides its name as they sought to use artificial intelligence to improve efficiency in a range of fields.
"We ended up building six iterations of Fireflies before this current meeting assistant," Udotong remembers. "And every time we would build a different iteration, we would tell our friends, 'Download it, use it, and get back to us next week, we'll grab coffee.' We were making all these agreements and promises, and it became really challenging to keep track of all the conversations we were having to get our products out there. We thought, 'What if we just had an AI that could keep track of conversations for us?'"
The founders' initial note-taking solution, built in short bursts between classes and homework, tracked action items written in messages, sending reminders to users later on.
Following Udotong's graduation with a degree in aeronautics and astronautics in 2016, the founders decided to use a $25,000 stipend they received from Rough Draft Ventures, along with $5,000 from the MIT Sandbox Innovation Fund, to work on Fireflies through the summer.
The plan was to work on Fireflies for another short burst: Ramineni was already making plans to attend Cambridge University for his master's degree in the fall, and Udotong was weighing acceptance letters from graduate schools as well as job offers. By July, however, the founders had changed their plans.
"I think deciding [on a career path] is really hard these days, even if you identify your passion," Udotong says. "The easy path for someone in tech is to follow the money and go work for Google or Facebook. We decided to go a different route and take the risk."
They moved to Ramineni's hometown of San Francisco to officially launch the company. Udotong remembers getting to San Francisco with $100 dollars in his bank account.
The founders had fully committed themselves to Fireflies, but it didn't make starting the company any easier. They decided not to raise venture capital in the company's early years, and Ramineni admits to questioning whether going all in on Fireflies was the right decision as recently at 2018.
The founders also weren't sure a radically new software category would be embraced so readily by businesses. They continued to invest in the voice AI space, as they believed that the need for their technology was growing and the timing was right.
"We realized that there's a ton of data generated every day through speech, either in meetings like Zoom or in person," Ramineni says. "Today, two hours after your meeting, unless you're taking good notes or recording, you're not going to be able to recall everything. You might not even remember what action items you agreed to a few hours ago. It's such a common problem that people don't even know it's an issue. You have meetings and you expect things to slip through the cracks."
Illuminating conversations
Today the Fireflies solution shows little trace of the arduous journey the founders took to get to this point. In fact, building simplicity into the tool has been a major focus for the founders.
