StrategyQA and Big Bench

Published: Nov. 18, 2022, 3:39 a.m.

Did Aristotle Use a Laptop?\xa0 That's a question from the StrategyQA benchmark which highlights the stretch goals for current artificial intelligence systems.\xa0 Answering a question like that requires several cognitive steps and reasoning.\xa0 Constructing a dataset of similarly challenging questions is a major undertaking.\xa0 On today's episode, Mor Geva returns to share details about the creation of StrategyQA and the larger Big Bench dataset it has been included in.