Here is an extremely early stage project that a friend and I have been working on this summer. DeepQuiz generates quiz questions from user-submitted text. Currently we're using a combination of statistical analysis and heuristic rules to do this - no machine learning. The main point in its favor right now is that it's free to use and pretty fast.
We would really appreciate your feedback, as well as ideas for how it could be better, and types of generated questions you would like to see. The system does best with English text.
Nice work! My suggestion at the moment is to avoid excessively long true/false questions (unless you actually plan to modify them, but that can be incredibly hard), and to use Named Entity Recognition/detection and semantic similarity (Word2Vec/Glove) for multiple-choice questions. I guess you are already using the former, but with the latter you should be able to really constrain the options to something more "credible".
This is a pretty cool project! You should take a look at this paper : https://arxiv.org/abs/1705.02012 . Using your heuristics to select the answers, you maybe able to generate some non fill in the blank questions. (All I saw was fill in the blank, not sure if it does other types of questions)
This looks cool! As you probably already know, it has some ways to go. Simple English Wikipedia would have plenty of content with sentences that are easier to parse. Also, it'd be pretty cool to see general trivia quizzes autogenerated from Wikipedia using your algo.
This is exactly the sort of project I wanted to implement, but linked to more than one data source. I was thinking wikipedia + stack overflow or something like that. My dream is to create a system like this one which dynamically creates questions in a media-wiki article. I think we need to think about categories of question. True / False and multiple choice are only one part of "knowing something".
To what extent does someone know something? This is probably a better way to approach asking questions. We also think about "blooms taxonomy of knowing" which is helpful for thinking about different types of assessment tasks.
I would imagine generating the questions would be first, and then ranking them according various tiers of knowledge.
I have lots of text about a particular topic (50K Articles crawled from internet about travel experiences). Now I want to create a Q&A from this given text.
Is there any service that can do it? Basically I want to feed my text to this service and it creates a Q&A pairs from this given text. Not sure If I made it clear..
Nice project, a group I worked on did something very similar with retrieving questions from a syllabus. Is this open source? I'd be fascinated to see similarities/differences in our approaches.
[+] [-] forrestbrazeal|8 years ago|reply
Here is an extremely early stage project that a friend and I have been working on this summer. DeepQuiz generates quiz questions from user-submitted text. Currently we're using a combination of statistical analysis and heuristic rules to do this - no machine learning. The main point in its favor right now is that it's free to use and pretty fast.
We would really appreciate your feedback, as well as ideas for how it could be better, and types of generated questions you would like to see. The system does best with English text.
[+] [-] gattilorenz|8 years ago|reply
[+] [-] damvigilante|8 years ago|reply
[+] [-] nessup|8 years ago|reply
[+] [-] rocketsentence|8 years ago|reply
[+] [-] bill_mackenty|8 years ago|reply
To what extent does someone know something? This is probably a better way to approach asking questions. We also think about "blooms taxonomy of knowing" which is helpful for thinking about different types of assessment tasks.
I would imagine generating the questions would be first, and then ranking them according various tiers of knowledge.
[+] [-] amrrs|8 years ago|reply
[+] [-] zerop|8 years ago|reply
Is there any service that can do it? Basically I want to feed my text to this service and it creates a Q&A pairs from this given text. Not sure If I made it clear..
[+] [-] codefined|8 years ago|reply
[+] [-] cyborgx7|8 years ago|reply
[+] [-] mindhash|8 years ago|reply
[+] [-] badmon|8 years ago|reply
[+] [-] dhdersch|8 years ago|reply