I'm super happy that these types of deep research applications are being released because it seems like such an obvious use case for LLMs.
I ran Perplexity through some of my test queries for these.
One query that it choked hard on was, "List the college majors of all of the Fortune 100 CEOs"
OpenAI and Gemini both handle this somewhat gracefully producing a table of results (though it takes a few follow ups to get a correct list). Perplexity just kind of rambles generally about the topic.
There are other examples I can give of similar failures.
Seems like generally it's good at summarizing a single question (Who are the current Fortune 100 CEOs) but as soon as you need to then look up a second list of data and marry the results it kind of falls apart.
Hopefully the end user of these products know something about LLMs and why asking a question such as "List the college majors of all of the Fortune 100 CEOs" is not really suited well for them.
You are a bit behind. All the "deep research" tools, and paid AI search tools in general, combine LLMs with search. When I do research on you.com it routinely searches a 100 sites. Even Google searches get Gemini'd now. I had to chuckle because your very link provides a demonstration.
Quite the opposite. I'm familiar enough with these systems to know that asking the question "List the college majors of all Fortune 100 CEOs" is not going to get you a correct answer, Gemini and you.com included. I am happy to be proven wrong. :)
If you know more than others, it would be great to share some of what you know, so the rest of us can learn. Comments that only declare how much you know, without sharing any of it, are less useful, and ultimately off-topic.
I ran Perplexity through some of my test queries for these.
One query that it choked hard on was, "List the college majors of all of the Fortune 100 CEOs"
OpenAI and Gemini both handle this somewhat gracefully producing a table of results (though it takes a few follow ups to get a correct list). Perplexity just kind of rambles generally about the topic.
There are other examples I can give of similar failures.
Seems like generally it's good at summarizing a single question (Who are the current Fortune 100 CEOs) but as soon as you need to then look up a second list of data and marry the results it kind of falls apart.