Meet your AI Executive Assistant

I know it&#x27;s unrealistic, but I wish this were a local appliance I could buy. Maybe plug into Home Assistant too.<p>Sending all my data off to two external services might be a bridge too far for me... Then again, I don&#x27;t trust Microsoft or Google either.

I was ready to give you my money, but you&#x27;re Gmail only, sorry, I migrated out so will wait for IMAP support.

I was in the early beta and judging from how it&#x27;s worked in my tests, there&#x27;s definitely more going on under the hood then the most straightforward approach of &quot;embed all your emails, find nearest neighbors, then ask the LLM to answer&quot;.<p>Kudos on innovating around applying LLMs to real-world problems and going beyond the bog-standard approach. It&#x27;d be interesting to see a more detailed blog on the technical approach you took!

[Co-founder of Shortwave here] I know a lot of folks are launching “AI Assistants” right now – but ours isn’t just a “chat with your PDF” thin shim on GPT4. We’ve got some serious infrastructure behind this.<p>Here are some notes on our architecture:<p>- We use LLMs at multiple places to choose what data to pull at each step. We use an additive approach rather than a chaining approach to avoid error propagation. We use GPT3.5-turbo with a bunch of hand-rolled prompts for most of this.<p>- We’re using InstructorXL + Pinecone running on GCP for vector-based search. We combine this with more traditional search methods backed by Postgres &amp; Elasticsearch, to give the assistant the ability to fast searches of multiple types. We use a x-encoding model trained on open source Q&amp;A data from Bing for scoring &amp; reranking to allow us to combine multiple data sources and determine what makes the most sense to feed into the final prompt.<p>- We hand-rolled a bunch of rule-based algorithms and heuristics on top of the LLMs to deal with email-specific corner cases and other issues we couldn’t resolve reliably in prompts<p>- Our user-facing output is generated with GPT4.<p>This enables a bunch of capabilities that other AI assistants can’t match:<p>- Way better search — Ask a question and get a succinct direct answer, including finding emails that would be tough for you to find through traditional search (ie. you can’t remember a keyword to use).<p>- Scheduling – Since we can dynamically pull in multiple types of data, we can access calendar data at the right time to help you schedule meetings.<p>- Analyze across multiple emails &amp; types of data - The assistant can synthesize answers across multiple emails, your calendar, setting, etc to give you an answer (eg. “What are the top 5 issues that customers emails support about last week”, “what are some meeting times that work for me and the other people on this thread”),<p>- Write in your voice — the assistant can automatically learn your style and tone based on your sent emails. This means it actually sounds like you and, while it still requires some tweaking occasionally, it’ll save you a lot of time.<p>- Summarize &amp; translate – it can dynamically access the data you have <i>on your screen right now</i> if you reference it, so it can help you with whatever you’re reading.<p>A note on privacy: We take privacy very seriously. We’re running everything above on our own GPUs + using OpenAI for final outputs. We aren’t training any models on user data.<p>We’ve put a lot of thought and effort into this one – I hope you like it – either way, let me know what you think in the comments below!<p>-Andrew

The pitch could use a bit of work. I had to muster a lot of willpower to read all those paragraphs to figure out what the product even does. It would greatly benefit from more straightforward writing.<p>When I clicked, I hoped that it could manage the tedium of dealing with emails:<p>- Negotiating meeting dates and adding events to my calendar.<p>- Combining pointless corporate emails into an executive summary, or deleting them as they come.<p>- Surfacing metadata when appropriate: the phone number of the person I should call, directions to a mentioned place, profiles of mentioned people.<p>A good executive assistant gets stuff out of the way. They reduce friction and let you focus on work that matters. &quot;You have to be in Frankfurt? Here are your tickets. You are checked in. A taxi will pick you up in the afternoon. Your hotel is booked. I sent the address to your phone&quot;. There is so much low-level tedium<p>To me, this tool feels like ChatGPT with access to my emails. You still have to converse with it, ask it specifically for what you want. Instead of magically sorting the things I don&#x27;t want to deal with, it handles the thing <i>I</i> should be dealing with: working with other humans.

The pricing page claims that the free tier allows searching of email history up to 90 days ago, but when using it, the AI assistant says that searching of email history requires upgrading to the Standard plan.