Skip to content

collect the open dialog corpus and some useful data processing utils.

Notifications You must be signed in to change notification settings

JohannesTK/openDialogCorpus

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

1. FRAMES

Tags

2017, Multi-turn, Goal-oriented, Frame-tracking(Dialog State Tracking)

Abstract:

This paper presents the Frames dataset, a corpus of 1369 human-human dialogues with an average of 15 turns per dialogue. We developed this dataset to study the role of memory in goal-oriented dialogue systems. Based on Frames, we introduce a task called frame tracking, which extends state tracking to a setting where several states are tracked simultaneously. We propose a baseline model for this task. We show that Frames can also be used to study memory in dialogue management and information presentation through natural language generation.

相关论文A Frame Tracking Model for Memory-Enhanced Dialogue Systems

2. Sarcasm Corpus V2

Tags

2017, Sarcasm

Abstract:

The use of irony and sarcasm in social media allows us to study them at scale for the first time. However, their diversity has made it difficult to construct a high-quality corpus of sarcasm in dialogue. Here, we describe the process of creating a largescale, highly-diverse corpus of online debate forums dialogue, and our novel methods for operationalizing classes of sarcasm in the form of rhetorical questions and hyperbole. We show that we can use lexico-syntactic cues to reliably retrieve sarcastic utterances with high accuracy. To demonstrate the properties and quality of our corpus, we conduct supervised learning experiments with simple features, and show that we achieve both higher precision and F than previous work on sarcasm in debate forums dialogue. We apply a weakly-supervised linguistic pattern learner and qualitatively analyze the linguistic differences in each class.

Paper:

Creating and Characterizing a Diverse Corpus of Sarcasm in Dialogue

IAC 2.0: https://nlds.soe.ucsc.edu/iac2

About

collect the open dialog corpus and some useful data processing utils.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%