Our latest publications - LTG

• Kutuzov, Andrei; Øvrelid, Lilja; Szymanski, Terrence & Velldal, Erik (2018). Diachronic word embeddings and semantic shifts: a survey, In  Proceedings of the 27th International Conference on Computational Linguistics.  Association for Computational Linguistics.  ISBN 978-1-948087-50-6.  conference paper.  s 1384 - 1397 Show summary

  Recent years have witnessed a surge of publications aimed at tracing temporal changes in lexical semantics using distributional methods, particularly prediction-based word embedding models. However, this vein of research lacks the cohesion, common terminology and shared practices of more established areas of natural language processing. In this paper, we survey the current state of academic research related to diachronic word embeddings and semantic shifts detection. We start with discussing the notion of semantic shifts, and then continue with an overview of the existing methods for tracing such time-related shifts with word embedding models. We propose several axes along which these methods can be compared, and outline the main challenges before this emerging subfield of NLP, as well as prospects and possible applications.

• Nooralahzadeh, Farhad & Øvrelid, Lilja (2018). Syntactic Dependency Representations in Neural Relation Classification, In Georgiana Dinu; Miguel Ballesteros; Avirup Sil; Sam Bowman; Wael Hamza; Anders Søgaard; Tahira Naseem & Yoav Goldberg (ed.),  Proceedings of the Workshop on the Relevance of Linguistic Structure in Neural Architectures for NLP.  Association for Computational Linguistics.  ISBN 978-1-948087-42-1.  Article.
• Ustalov, Dmitry; Panchenko, Alexander; Kutuzov, Andrei; Biemann, Chris & Ponzetto, Simone (2018). Unsupervised Semantic Frame Induction using Triclustering, In  Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers).  Association for Computational Linguistics.  ISBN 978-1-948087-34-6.  conference paper.  s 55 - 62 Show summary

  We use dependency triples automatically extracted from a Web-scale corpus to perform unsupervised semantic frame induction. We cast the frame induction problem as a triclustering problem that is a generalization of clustering for triadic data. Our replicable benchmarks demonstrate that the proposed graph-based approach, Triframes, shows state-of-the art results on this task on a FrameNet-derived dataset and performing on par with competitive methods on a verb class clustering task.

• Kutuzov, Andrei (2018). Russian Word Sense Induction by Clustering Averaged Word Embeddings. Komp'yuternaya Lingvistika i Intellektual'nye Tekhnologii.  ISSN 2221-7932.  (17), s 391- 403 Show summary

  The paper reports our participation in the shared task on word sense induction and disambiguation for the Russian language (RUSSE’2018). Our team was ranked 2nd for the wiki-wiki dataset (containing mostly homonyms) and 5th for the bts-rnc and active-dict datasets (containing mostly polysemous words) among all 19 participants. The method we employed was extremely naive. It implied representing contexts of ambiguous words as averaged word embedding vectors, using off-the-shelf pre-trained distributional models. Then, these vector representations were clustered with mainstream clustering techniques, thus producing the groups corresponding to the ambiguous word’ senses. As a side result, we show that word embedding models trained on small but balanced corpora can be superior to those trained on large but noisy data—not only in intrinsic evaluation, but also in downstream tasks like word sense induction.

• Nooralahzadeh, Farhad; Øvrelid, Lilja & Lønning, Jan Tore (2018). SIRIUS-LTG-UiO at SemEval-2018 Task 7: Convolutional Neural Networks with Shortest Dependency Paths for Semantic Relation Extraction and Classification in Scientific Papers, In  Proceedings of the 12th International Workshop on Semantic Evaluation.  Association for Computational Linguistics.  ISBN 978-1-948087-20-9.  Article.  s 805 - 811
• Nooralahzadeh, Farhad; Øvrelid, Lilja & Lønning, Jan Tore (2018). Evaluation of Domain-specific Word Embeddings using Knowledge Resources, In Nicoletta Calzolari; Khalid Choukri; Christopher Cieri; Thierry Declerck; Sara Goggi; Koiti Hasida; Hitoshi Isahara; Bente Maegaard; Joseph Mariani; Hélène Mazo; Asuncion Moreno; Jan Odijk; Stelios Piperidis & Takenobu Tokunaga (ed.),  Proceedings of the Eleventh International Conference on Language Resources and Evaluation.  European Language Resources Association.  ISBN 979-10-95546-00-9.  Article.  s 1438 - 1445
• Velldal, Erik; Øvrelid, Lilja; Bergem, Eivind Alexander; Stadsnes, Cathrine; Touileb, Samia & Jørgensen, Fredrik (2018). NoReC: The Norwegian Review Corpus, In Nicoletta Calzolari; Khalid Choukri; Christopher Cieri; Thierry Declerck; Sara Goggi; Koiti Hasida; Hitoshi Isahara; Bente Maegaard; Joseph Mariani; Hélène Mazo; Asuncion Moreno; Jan Odijk; Stelios Piperidis & Takenobu Tokunaga (ed.),  Proceedings of the Eleventh International Conference on Language Resources and Evaluation.  European Language Resources Association.  ISBN 979-10-95546-00-9.  Article.  s 4186 - 4191 Show summary

  This paper presents the Norwegian Review Corpus (NoReC), created for training and evaluating models for document-level sentiment analysis. The full-text reviews have been collected from major Norwegian news sources and cover a range of different domains, including literature, movies, video games, restaurants, music and theater, in addition to product reviews across a range of categories. Each review is labeled with a manually assigned score of 1–6, as provided by the rating of the original author. This first release of the corpus comprises more than 35,000 reviews. It is distributed using the CoNLL-U format, pre-processed using UDPipe, along with a rich set of metadata. The work reported in this paper forms part of the SANT initiative (Sentiment Analysis for Norwegian Text), a project seeking to provide open resources and tools for sentiment analysis and opinion mining for Norwegian.

• Lapponi, Emanuele; Søyland, Martin G.; Velldal, Erik & Oepen, Stephan (2018). The Talk of Norway: A Richly Annotated Corpus of the Norwegian Parliament, 1998–2016. Language Resources and Evaluation.  ISSN 1574-020X. . doi: 10.1007/s10579-018-9411-5 Show summary

  In this work we present the Talk of Norway (ToN) data set, a collection of Norwegian Parliament speeches from 1998 to 2016. Every speech is richly annotated with metadata harvested from different sources, and augmented with language type, sentence, token, lemma, part-of-speech, and morphological feature annotations. We also present a pilot study on party classification in the Norwegian Parliament, carried out in the context of a cross-faculty collaboration involving researchers from both Political Science and Computer Science. Our initial experiments demonstrate how the linguistic and institutional annotations in ToN can be used to gather insights on how different aspects of the political process affect classification.

• Kutuzov, Andrei & Kunilovskaya, Maria (2018). Size vs. Structure in Training Corpora for Word Embedding Models: Araneum Russicum Maximum and Russian National Corpus. Lecture Notes in Computer Science.  ISSN 0302-9743.  10716 . doi: https://doi.org/10.1007/978-3-319-73013-4_5 Show summary

  In this paper, we present a distributional word embedding model trained on one of the largest available Russian corpora: Araneum Russicum Maximum (over 10 billion words crawled from the web). We compare this model to the model trained on the Russian National Corpus (RNC). The two corpora are much different in their size and compilation procedures. We test these differences by evaluating the trained models against the Russian part of the Multilingual SimLex999 semantic similarity dataset. We detect and describe numerous issues in this dataset and publish a new corrected version. Aside from the already known fact that the RNC is generally a better training corpus than web corpora, we enumerate and explain fine differences in how the models process semantic similarity task, what parts of the evaluation set are difficult for particular models and why. Additionally, the learning curves for both models are described, showing that the RNC is generally more robust as training material for this task.

• Flickinger, Dan; Oepen, Stephan & Bender, Emily (2017). Sustainable Development and Refinement of Complex Linguistic Annotations at Scale, In Nancy Ide & James Pustejovsky (ed.),  Handbook of Linguistic Annotation.  Springer.  ISBN 978-94-024-0879-9.  Chapter.  s 353 - 377
• Kunilovskaya, Maria & Kutuzov, Andrei (2017). Universal Dependencies-based syntactic features in detecting human translation varieties, In Jan Hajič (ed.),  Proceedings of the 16th International Workshop on Treebanks and Linguistic Theories.  Association for Computational Linguistics.  ISBN 978-80-88132-04-2.  chapter.  s 27 - 36 Show summary

  In this paper, syntactic annotation is used to reveal linguistic properties of translations. We employ the Universal Dependencies framework to represent learner and professional translations of English mass-media texts into Russian (along with non-translated Russian texts of the same genre) with the aim to discover and describe syntactic specificity of translations produced at different levels of competence. The search for differences between varieties of translation and the native texts is augmented with the results obtained from a series of machine learning classifications experiments. We show that syntactic structures have considerable predictive power in translationese detection, on par with the known low-level lexical features.

• Eckart de Castilho, Richard; Ide, Nancy; Lapponi, Emanuele; Oepen, Stephan; Suderman, Keith; Velldal, Erik & Verhagen, Marc (2017). Representation and Interchange of Linguistic Annotation. An In-Depth, Side-by-Side Comparison of Three Designs, In Nathan Schneider & Nianwen Xue (ed.),  Proceedings of the 11th Linguistic Annotation Workshop.  Association for Computational Linguistics.  ISBN 978-1-945626-39-5.  Chapter.  s 67 - 75
• Smirnov, Ivan V.; Kuznetsova, Rita; Kopotev, Mikhail; Khazov, Andrey; Lyashevskaya, Olga; Ivanova, L. & Kutuzov, Andrei (2017). Evaluation tracks on plagiarism detection algorithms for the Russian language. Komp'yuternaya Lingvistika i Intellektual'nye Tekhnologii.  ISSN 2221-7932.  1(16), s 271- 283
• Lapponi, Emanuele; Oepen, Stephan & Øvrelid, Lilja (2017). EPE 2017: The Sherlock Negation Resolution Downstream Application, In Stephan Oepen (ed.),  Proceedings of the 2017 Shared Task on Extrinsic Parser Evaluation at the Fourth International Conference on Dependency Linguistics and the 15th International Conference on Parsing Technologies.  Association for Computational Linguistics.  ISBN 978-1-945626-74-6.  Article.  s 25 - 30
• Oepen, Stephan; Øvrelid, Lilja; Björne, Jari; Johansson, Richard; Lapponi, Emanuele; Ginter, Filip & Velldal, Erik (2017). The 2017 Shared Task on Extrinsic Parser Evaluation: Towards a Reusable Community Infrastructure, In Stephan Oepen (ed.),  Proceedings of the 2017 Shared Task on Extrinsic Parser Evaluation at the Fourth International Conference on Dependency Linguistics and the 15th International Conference on Parsing Technologies.  Association for Computational Linguistics.  ISBN 978-1-945626-74-6.  Article.  s 1 - 16
• Kutuzov, Andrei & Kuzmenko, Elizaveta (2017). Two centuries in two thousand words: Neural embedding models in detecting diachronic lexical changes, In  Quantitative Approaches to the Russian Language.  Routledge.  ISBN 9781138097155.  chapter. Show summary

  In this paper, we show how Continuous Bag-of-Words (Mikolov et al., 2013) models trained on time-separated sub-corpora of the Russian National Corpus can be used to detect automatically words that may have undergone semantic changes. Our central assumption is that online training of such models with new textual data results in a “drift” of word vectors in the semantic space. Given that vectors represent the “meaning” of entities, this drift can be taken to reflect semantic shifts in the words experiencing it. As a result, we were able to closely replicate manually compiled lists of semantically changed Russian words from the existing body of research and substantially extend them in a largely unsupervised way. This idea is one of the reasons for the title of this paper, which in a way serves as a complement to the “20 words” in (Daniel & Dobrushina, 2016).

• Kutuzov, Andrei; Velldal, Erik & Øvrelid, Lilja (2017). Temporal dynamics of semantic relations in word embeddings: an application to predicting armed conflict participants, In  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.  Association for Computational Linguistics.  ISBN 978-1-945626-83-8.  chapter.  s 1825 - 1830 Full text in Research Archive. Show summary

  This paper deals with using word embedding models to trace the temporal dynamics of semantic relations between pairs of words. The set-up is similar to the well-known analogies task, but expanded with a time dimension. To this end, we apply incremental updating of the models with new training texts, including incremental vocabulary expansion, coupled with learned transformation matrices that let us map between members of the relation. The proposed approach is evaluated on the task of predicting insurgent armed groups based on geographical locations. The gold standard data for the time span 1994--2010 is extracted from the UCDP Armed Conflicts dataset. The results show that the method is feasible and outperforms the baselines, but also that important work still remains to be done.

• Kutuzov, Andrei; Velldal, Erik & Øvrelid, Lilja (2017). Tracing armed conflicts with diachronic word embedding models, In Tommaso Caselli (ed.),  Proceedings of the Events and Stories in the News Workshop.  Association for Computational Linguistics.  ISBN 978-1-945626-63-0.  Chapter.  s 31 - 36 Full text in Research Archive. Show summary

  Recent studies have shown that word embedding models can be used to trace time-related (diachronic) semantic shifts for particular words. In this paper, we evaluate some of these approaches on the new task of predicting the dynamics of global armed conflicts on a year-to-year basis, using a dataset from the field of conflict research as the gold standard and the Gigaword news corpus as the training data. The results show that much work still remains in extracting `cultural' semantic shifts from diachronic word embedding models. At the same time, we present a new task complete with an evaluation set and introduce the `anchor words' method which outperforms previous approaches on this data.

• Kunilovskaya, Maria & Kutuzov, Andrei (2017). Testing target text fluency: A machine learning approach to detecting syntactic translationese in English-Russian translation, In  New perspectives on cohesion and coherence: Implications for translation.  Language Science Press.  ISBN 978-3-946234-72-2.  Chapter 5.  s 75 - 103 Show summary

  This research is aimed at the semi-automatic detection of divergences in sentence structures between Russian translated texts and non-translations. We focus our attention on atypical syntactic features of translations, because they have a greater negative impact on the overall textual quality than lexical translationese. Inadequate syntactic structures bring about various issues with target text fluency, which reduces readability and the reader's chances to get to the text message. From a procedural viewpoint, faulty syntax implies more post-editing effort. In the framework of this research, we reveal cases of syntactic translationese as dissimilarities between patterns of selected morphosyntactic and syntactic features (such as part of speech and sentence length) in the context of sentence boundaries observed in comparable monolingual corpora of learner translated and non-translated texts in Russian. To establish these syntactic differences we resort to a machine learning approach as opposed to the usual statistical significance analyses. To this end we employ models that predict unnatural sentence boundaries in translations and highlight factors that are responsible for their `foreignness'. For the first stage of the experiment, we train a decision tree model to describe the contextual features of sentence boundaries in the reference corpus of Russian texts. At the second stage, we use the results of the first multifactorial analysis as indicators of learner translators' choices that run counter to the regularities of the standard language variety. The predictors and their combinations are evaluated as to their efficiency for this task. As a result we are able to extract translated sentences whose structure is atypical against Russian texts produced without the constraints of the translation process and which, therefore, can be tentatively considered less fluent. These sentences represent cases of translationese.

• Kutuzov, Andrei & Kuzmenko, Elizaveta (2017). WebVectors: A toolkit for building web interfaces for vector semantic models. Communications in Computer and Information Science.  ISSN 1865-0929.  661, s 155- 161 . doi: 10.1007/978-3-319-52920-2_15 Show summary

  The paper presents a free and open source toolkit which aim is to quickly deploy web services handling distributed vector models of semantics. It fills in the gap between training such models (many tools are already available for this) and dissemination of the results to general public. Our toolkit, WebVectors, provides all the necessary routines for organizing online access to querying trained models via modern web interface. We also describe two demo installations of the toolkit, featuring several efficient models for English, Russian and Norwegian.

• Kutuzov, Andrei (2017). Arbitrariness of Linguistic Sign Questioned: Correlation between Word Form and Meaning in Russian. Komp'yuternaya Lingvistika i Intellektual'nye Tekhnologii.  ISSN 2221-7932.  1(16), s 109- 120 Full text in Research Archive. Show summary

  In this paper, we present the results of preliminary experiments on finding the link between the surface forms of Russian nouns (as represented by their graphic forms) and their meanings (as represented by vectors in a distributional model trained on the Russian National Corpus). We show that there is a strongly significant correlation between these two sides of a linguistic sign (in our case, word). This correlation coefficient is equal to 0.03 as calculated on a set of 1 729 mono-syllabic nouns, and in some subsets of words starting with particular two-letter sequences the correlation raises as high as 0.57. The overall correlation value is higher than the one reported in similar experiments for English (0.016). Additionally, we report correlation values for the noun subsets related to different phonaesthemes, supposedly represented by the initial characters of these nouns.

• Enger, Martine; Velldal, Erik & Øvrelid, Lilja (2017). An open-source tool for negation detection: a maximum-margin approach, In Eduardo Blanco; Roser Morante & Roser Saurí (ed.),  Proceedings of the Workshop on Computational Semantics Beyond Events and Roles.  Association for Computational Linguistics.  ISBN 978-1-945626-49-4.  Artikkel W17-1810.  s 64 - 69 Show summary

  This paper presents an open-source toolkit for negation detection. It identifies negation cues and their corresponding scope in either raw or parsed text using maximum-margin classification. The system design draws on best practice from the existing literature on negation detection, aiming for a simple and portable system that still achieves competitive performance. Pre-trained models and experimental results are provided for English.

• Sand, Heidi Marion; Velldal, Erik & Øvrelid, Lilja (2017). Wordnet extension via word embeddings: Experiments on the Norwegian Wordnet, In Jörg Tiedemann (ed.),  Proceedings of the 21st Nordic Conference on Computational Linguistics (NoDaLiDa).  Linköping University Electronic Press.  ISBN 978-91-7685-601-7.  Article no. 042.  s 298 - 302 Show summary

  This paper describes the process of automatically adding synsets and hypernymy relations to an existing wordnet based on word embeddings computed for POStagged lemmas in a large news corpus, achieving exact match attachment accuracy of over 80%. The reported experiments are based on the Norwegian Wordnet, but the method is language independent and also applicable to other wordnets. Moreover, this study also represents the first documented experiments of the Norwegian Wordnet.

• Hohle, Petter; Øvrelid, Lilja & Velldal, Erik (2017). Optimizing a PoS Tagset for Norwegian Dependency Parsing, In Jörg Tiedemann (ed.),  Proceedings of the 21st Nordic Conference on Computational Linguistics (NoDaLiDa).  Linköping University Electronic Press.  ISBN 978-91-7685-601-7.  Article no. 017.  s 142 - 151 Show summary

  This paper reports on a suite of experiments that evaluates how the linguistic granularity of part-of-speech tagsets impacts the performance of tagging and syntactic dependency parsing. Our results show that parsing accuracy can be significantly improved by introducing more finegrained morphological information in the tagset, even if tagger accuracy is compromised. Our taggers and parsers are trained and tested using the annotations of the Norwegian Dependency Treebank.

• Velldal, Erik; Øvrelid, Lilja & Hohle, Petter (2017). Joint UD Parsing of Norwegian Bokmål and Nynorsk, In Jörg Tiedemann (ed.),  Proceedings of the 21st Nordic Conference on Computational Linguistics (NoDaLiDa).  Linköping University Electronic Press.  ISBN 978-91-7685-601-7.  Article no. 001.  s 1 - 10 Show summary

  This paper investigates interactions in parser performance for the two official standards for written Norwegian: Bokmål and Nynorsk. We demonstrate that while applying models across standards yields poor performance, combining the training data for both standards yields better results than previously achieved for each of them in isolation. This has immediate practical value for processing Norwegian, as it means that a single parsing pipeline is sufficient to cover both varieties, with no loss in accuracy. Based on the Norwegian Universal Dependencies treebank we present results for multiple taggers and parsers, experimenting with different ways of varying the training data given to the learners, including the use of machine translation.

• Lison, Pierre & Kutuzov, Andrei (2017). Redefining Context Windows for Word Embedding Models: An Experimental Study, In Jörg Tiedemann (ed.),  Proceedings of the 21st Nordic Conference on Computational Linguistics (NoDaLiDa).  Linköping University Electronic Press.  ISBN 978-91-7685-601-7.  chapter.  s 284 - 288 Show summary

  Distributional semantic models learn vector representations of words through the contexts they occur in. Although the choice of context (which often takes the form of a sliding window) has a direct influence on the resulting embeddings, the exact role of this model component is still not fully understood. This paper presents a systematic analysis of context windows based on a set of four distinct hyperparameters. We train continuous Skip- Gram models on two English-language corpora for various combinations of these hyper-parameters, and evaluate them on both lexical similarity and analogy tasks. Notable experimental results are the positive impact of cross-sentential contexts and the surprisingly good performance of right-context windows.

• Kutuzov, Andrei; Fares, Murhaf; Oepen, Stephan & Velldal, Erik (2017). Word vectors, reuse, and replicability: Towards a community repository of large-text resources, In Jörg Tiedemann (ed.),  Proceedings of the 21st Nordic Conference on Computational Linguistics (NoDaLiDa).  Linköping University Electronic Press.  ISBN 978-91-7685-601-7.  chapter.  s 271 - 276 Show summary

  This paper describes an emerging shared repository of large-text resources for creating word vectors, including pre-processed corpora and pre-trained vectors for a range of frameworks and configurations. This will facilitate reuse, rapid experimentation, and replicability of results.

• Kutuzov, Andrei; Kuzmenko, Elizaveta & Pivovarova, Lidia (2017). Clustering of Russian Adjective-Noun Constructions using Word Embeddings, In Lidia Pivovarova; Jakub Piskorski & Tomaž Erjavec (ed.),  Proceedings of the 6th Workshop on Balto-Slavic Natural Language Processing.  Association for Computational Linguistics.  ISBN 978-1-945626-45-6.  chapter.  s 3 - 13 Full text in Research Archive. Show summary

  This paper presents a method of automatic construction extraction from a large corpus of Russian. The term `construction' here means a multi-word expression in which a variable can be replaced with another word from the same semantic class, for example, 'a glass of [water/juice/milk]'. We deal with constructions that consist of a noun and its adjective modifier. We propose a method of grouping such constructions into semantic classes via 2-step clustering of word vectors in distributional models. We compare it with other clustering techniques and evaluate it against A Russian-English Collocational Dictionary of the Human Body that contains manually annotated groups of constructions with nouns denoting human body parts. The best performing method is used to cluster all adjective-noun bigrams in the Russian National Corpus. Results of this procedure are publicly available and can be used to build a Russian construction dictionary, accelerate theoretical studies of constructions as well as facilitate teaching Russian as a foreign language.

• Koslowa, Olga & Kutuzov, Andrei (2016). Improving Distributional Semantic Models Using Anaphora Resolution during Linguistic Preprocessing. Komp'yuternaya Lingvistika i Intellektual'nye Tekhnologii.  ISSN 2221-7932.  15, s 288- 299
• Kuhlmann, Marco & Oepen, Stephan (2016). Towards a catalogue of linguistic graph banks. Computational Linguistics.  ISSN 0891-2017.  42(4), s 819- 827 . doi: 10.1162/COLI_a_00268
• Oepen, Stephan; Kuhlmann, Marco; Miyao, Yusuke; Zeman, Daniel; Cinková, Silvie; Flickinger, Dan; Hajič, Jan; Ivanova, Angelina & Urešová, Zdeňka (2016). Towards Comparability of Linguistic Graph Banks for Semantic Parsing, In  Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016).  European Language Resources Association.  ISBN 978-2-9517408-9-1.  Chapter.  s 3991 - 3995
• Read, Jonathon; Velldal, Erik; Cavazza, Marc & Georg, Gersende (2016). A corpus of clinical practice guidelines annotated with the importance of recommendations, In  Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016).  European Language Resources Association.  ISBN 978-2-9517408-9-1.  Kapittel.  s 1724 - 1731
• Oepen, Stephan; Read, Jonathon; Scheffler, Tatjana; Sidarenka, Uladzimir; Stede, Manfred; Velldal, Erik & Øvrelid, Lilja (2016). OPT: Oslo–Potsdam–Teesside. Pipelining Rules, Rankers, and Classifier Ensembles for Shallow Discourse Parsing, In Nianwen Xue (ed.),  Proceedings of the CoNLL-16 Shared Task.  Association for Computational Linguistics.  ISBN 978-1-932432-66-4.  Chapter.  s 20 - 26
• Fjeld, Ruth E Vatvedt & Saidi, Arash (2016). Hvordan slippe inn i Platons hage?, I: Asgerd Gudiksen & Henrik Hovmark (red.),  Nordiske Studier i Leksikografi 13 Rapport fra 13. Konference om Leksikografi i Norden København 19.-22. mai 2015.  Nordisk forening for leksikografi.  ISBN 978-87-992447-6-8.  Generelt program.  s 313 - 326
• Fares, Murhaf (2016). A Dataset for Joint Noun-Noun Compound Bracketing and Interpretation, In He He; Tao Lei & Will Roberts (ed.),  The 54th Annual Meeting of the Association for Computational Linguistics - Proceedings of the Student Research Workshop.  Association for Computational Linguistics.  ISBN 978-1-945626-02-9.  Article.  s 72 - 79
• Kutuzov, Andrei; Kuzmenko, Elizaveta & Marakasova, Anna (2016). Exploration of register-dependent lexical semantics using word embeddings, In  Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH).  Association for Computational Linguistics.  ISBN 978-4-87974-708-2.  Chapter.  s 26 - 34
• Ivanova, Angelina; Oepen, Stephan; Dridan, Rebecca; Flickinger, Dan; Øvrelid, Lilja & Lapponi, Emanuele (2016). On different approaches to syntactic analysis into bi-lexical dependencies: An empirical comparison of direct, PCFG-based, and HPSG-based parsers. Journal of Language Modelling.  ISSN 2299-856X.  4(1), s 113- 144
• Stoyanchev, Svetlana; Lison, Pierre & Bangalore, Srinivas (2016). Rapid Prototyping of Form-driven Dialogue Systems Using an Open-source Framework, In Raquel Fernández & Wolfgang Minker (ed.),  Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue.  Association for Computational Linguistics.  ISBN 978-1-945626-23-4.  1.  s 216 - 219 Show summary

  Most human-machine communication for information access through speech, text and graphical interfaces are mediated by forms – i.e. lists of named fields. However, deploying form-filling dialogue systems still remains a challenging task due to the effort and skill required to author such systems. We describe an extension to the OpenDial framework that enables the rapid creation of functional dialogue systems by non-experts. The dialogue designer specifies the slots and their types as input and the tool generates a domain specification that drives a slot-filling dialogue system. The presented approach provides several benefits compared to traditional techniques based on flowcharts, such as the use of probabilistic reasoning and flexible grounding strategies.

• Lison, Pierre & Kennington, Casey (2016). OpenDial: A Toolkit for Developing Spoken Dialogue Systems with Probabilistic Rules, In Sameer Pradhan & Marianna Apidianaki (ed.),  Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.  Association for Computational Linguistics.  ISBN 978-1-945626-03-6.  1.  s 67 - 72 Show summary

  We present a new release of OpenDial, an open-source toolkit for building and evaluating spoken dialogue systems. The toolkit relies on an information-state architecture where the dialogue state is represented as a Bayesian network and acts as a shared memory for all system modules. The domain models are specified via probabilistic rules encoded in XML. OpenDial has been deployed in several application domains such as human–robot interaction, intelligent tutoring systems and multi-modal in-car driver assistants.

• Dragone, Paolo & Lison, Pierre (2016). Classification and Resolution of Non-Sentential Utterances in Dialogue. Italian Journal of Computational Linguistics.  ISSN 2499-4553.  2(1), s 45- 62 Show summary

  This article addresses the problems of classification and resolution of non-sentential utterances (NSUs) in dialogue. NSUs are utterances that do not have a complete sentential form but convey a full clausal meaning given the conversational context, such as "To the contrary!" or "How much?". The presented approach builds upon the work of Fernández, Ginzburg, and Lappin (2007), who provide a taxonomy of NSUs divided in 15 classes along with a small annotated corpus extracted from dialogue transcripts. The main part of this article focuses on the automatic classification of NSUs according to these classes. We show that a combination of novel linguistic features and active learning techniques yields a significant improvement in the classification accuracy over the state-of-the-art, and is able to mitigate the scarcity of labelled data. Based on this classifier, the article also presents a novel approach for the semantic resolution of NSUs in context using probabilistic rules.

• Wester, Aksel Ladegård; Øvrelid, Lilja; Velldal, Erik & Hammer, Hugo Lewi (2016). Threat detection in online discussions, In  Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis WASSA@NAACL-HLT 2016 (WASSA 2016).  Association for Computational Linguistics.  ISBN 978-1-941643-82-2.  Artikkel.  s 66 - 71
• Kutuzov, Andrei; Velldal, Erik & Øvrelid, Lilja (2016). Redefining part-of-speech classes with distributional semantic models, In  Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning (CoNLL).  Association for Computational Linguistics.  ISBN 978-1-945626-19-7.  Chapter.  s 115 - 125 Full text in Research Archive.
• Øvrelid, Lilja & Hohle, Petter (2016). Universal Dependencies for Norwegian, In  Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016).  European Language Resources Association.  ISBN 978-2-9517408-9-1.  Artikkel.  s 1579 - 1585
• Lison, Pierre & Tiedemann, Jörg (2016). OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles, In  Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016).  European Language Resources Association.  ISBN 978-2-9517408-9-1.  1.  s 923 - 929 Full text in Research Archive. Show summary

  We present a new major release of the OpenSubtitles collection of parallel corpora. The release is compiled from a large database of movie and TV subtitles and includes a total of 1689 bitexts spanning 2.6 billion sentences across 60 languages. The release also incorporates a number of enhancements in the preprocessing and alignment of the subtitles, such as the automatic correction of OCR errors and the use of meta-data to estimate the quality of each subtitle and score subtitle pairs.

• Kutuzov, Andrei; Kopotev, Mikhail; Sviridenko, Tatyana & Ivanova, Lyubov (2016). Clustering Comparable Corpora of Russian and Ukrainian Academic Texts: Word Embeddings and Semantic Fingerprints, In  Proceedings of the Ninth Workshop on Building and Using Comparable Corpora, held at LREC-2016.  European Language Resources Association.  ISBN 978-2-9517408-9-1.  Conference paper.  s 3 - 10
• Kutuzov, Andrei & Kuzmenko, Elizaveta (2016). Neural Embedding Language Models in Semantic Clustering of Web Search Results, In  Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016).  European Language Resources Association.  ISBN 978-2-9517408-9-1.  Conference paper.  s 3044 - 3048
• Kutuzov, Andrei & Kuzmenko, Elizaveta (2016). Cross-lingual Trends Detection for Named Entities in News Texts with Dynamic Neural Embedding Models, In  Proceedings of the First International Workshop on Recent Trends in News Information Retrieval co-located with 38th European Conference on Information Retrieval (ECIR 2016).  Technical University of Aachen.  ISBN 978-3-319-30671-1.  Chapter.  s 27 - 32
• Fares, Murhaf; Oepen, Stephan & Velldal, Erik (2015). Identifying Compounds: On The Role of Syntax, In Markus Dickinson; Erhard Hinrichs; Agnieszka Patejuk & Adam Przepiórkowski (ed.),  Proceedings of the Fourteenth Workshop on Treebanks and Linguistic Theories (TLT14).  Institute of Computer Science, Polish Academy of Sciences (IPI-PAN).  ISBN 978-83-63159-18-4.  Article.
• Alonso, Hector Martinez; Plank, Barbara; Skjærholt, Arne & Søgaard, Anders (2015). Learning to parse with IAA-weighted loss, In Rada Mihalcea; Joyce Chai & Anoop Sarkar (ed.),  Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.  Association for Computational Linguistics.  ISBN 978-1-941643-49-5.  Artikkel.  s 1357 - 1361
• Dragone, Paolo & Lison, Pierre (2015). An Active Learning Approach to the Classification of Non-Sentential Utterances, In Cristina Bosco; Sara Tonelli & Fabio Massimo Zanzotto (ed.),  Proceedings of the Second Italian Conference on Computational Linguistics.  CLiC-IT 2015.  ISBN 978-88-99200-62-6.  papers.  s 115 - 119 Show summary

  This paper addresses the problem of classification of non-sentential utterances (NSUs). NSUs are utterances that do not have a complete sentential form but convey a full clausal meaning given the dialogue context. We extend the approach of Fernández et al. (2007), which provide a taxonomy of NSUs and a small annotated corpus extracted from dialogue transcripts. This paper demonstrates how the combination of new linguistic features and active learning techniques can mitigate the scarcity of labelled data. The results show a significant improvement in the classification accuracy over the state-of-the-art.

• Lien, Jostein; Velldal, Erik & Øvrelid, Lilja (2015). Improving cross-domain dependency parsing with dependency-derived clusters, In Beáta Megyesi (ed.),  Proceedings of the 20th Nordic Conference of Computational Linguistics.  Linköping University Electronic Press.  ISBN 978-91-7519-098-3.  Artikkel.  s 117 - 126 Full text in Research Archive.
• Szpektor, Idan; Tanev, Hristo; Dagan, Ido; Coppola, Bonaventura & Kouylekov, Milen (2015). Unsupervised acquisition of entailment relations from the Web. Natural Language Engineering.  ISSN 1351-3249.  21(01), s 3- 47 . doi: 10.1017/S1351324913000156
• Dragone, Paolo & Lison, Pierre (2015). Non-sentential utterances in dialogue: experiments in classification and interpretation. SemDial Proceedings.  ISSN 2308-2275.  s 170- 172
• Lison, Pierre & Kennington, Casey (2015). Developing Spoken Dialogue Systems with the OpenDial Toolkit. SemDial Proceedings.  ISSN 2308-2275.  s 194- 196
• Lien, Elisabeth & Kouylekov, Milen (2015). Semantic Parsing for Textual Entailment, In John Carroll; Koldo Gojenola & Stephan Oepen (ed.),  Proceedings of the 14th International Conference on Parsing Technologies.  Association for Computational Linguistics.  ISBN 978-1-941643-98-3.  Artikkel.  s 40 - 49
• Letcher, Ned; Dridan, Rebecca & Baldwin, Timothy (2015). gDelta: a missing link in the grammar engineering toolchain. Language Resources and Evaluation.  ISSN 1574-020X.  49(1), s 51- 75 . doi: 10.1007/s10579-014-9293-0
• Oepen, Stephan; Kuhlmann, Marco; Miyao, Yusuke; Zeman, Daniel; Cinková, Silvie; Flickinger, Dan; Hajič, Jan & Urešová, Zdeňka (2015). SemEval 2015 Task 18: Broad-Coverage Semantic Dependency Parsing, In Daniel Cer; David Jurgens; Preslav Nakov & Torsten Zesch (ed.),  Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015).  Association for Computational Linguistics.  ISBN 978-1-941643-40-2.  chapter.  s 915 - 926
• Agić, Željko; Koller, Alexander & Oepen, Stephan (2015). Semantic Dependency Graph Parsing Using Tree Approximations, In Matthew Purver; Mehrnoosh Sadrzadeh & Matthew Stone (ed.),  Proceedings of the 11th International Conference on Computational Semantics.  Association for Computational Linguistics.  ISBN 978-1-941643-33-4.  chapter.  s 217 - 227
• Bender, Emily; Flickinger, Dan; Oepen, Stephan; Packard, Woodley & Copestake, Ann (2015). Layers of Interpretation: On Grammar and Compositionality, In Matthew Purver; Mehrnoosh Sadrzadeh & Matthew Stone (ed.),  Proceedings of the 11th International Conference on Computational Semantics.  Association for Computational Linguistics.  ISBN 978-1-941643-33-4.  chapter.  s 239 - 249
• Lison, Pierre (2015). A hybrid approach to dialogue management based on probabilistic rules. Computer Speech and Language.  ISSN 0885-2308.  34(1), s 232- 255 . doi: 10.1016/j.csl.2015.01.001
• Skjærholt, Arne & Oepen, Stephan (2014). Estimating the Utility of Simplified Discriminants in Grammar-Based Treebanking, In Verena Henrich; Erhard Hinrichs; Daniel de Kok; Petya Osenova & Adam Przepiórkowski (ed.),  Proceedings of the Thirteenth International Workshop on Treebanks and Linguistic Theories (TLT13).  University of Tübingen.  ISBN 978-3-9809183-9-8.  Artikkel.  s 208 - 217 Show summary

  We investigate different types of discriminants in grammar-based treebanking, grounded in a review of earlier work; with an eye towards annotation by non-experts, we propose different simplifications of common discriminant types and quantify their ‘discriminative power’ as well as efficacy in the preparation of training data for a discriminative parse ranker.

• Hammer, Hugo Lewi; Solberg, Per Erik & Øvrelid, Lilja (2014). Sentiment classification of online political discussions: a comparison of a word-based and dependency-based method, In Alexandra Balahur (ed.),  5th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis.  Association for Computational Linguistics.  ISBN 978-1-634392-06-8.  1.  s 90 - 96 Full text in Research Archive.
• Miyao, Yusuke; Oepen, Stephan & Zeman, Daniel (2014). In-House: An Ensemble of Pre-Existing Off-the-Shelf Parsers, In Preslav Nakov & Torsten Zesch (ed.),  Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014).  Association for Computational Linguistics.  ISBN 978-1-941643-24-2.  Chapter.  s 335 - 340
• Oepen, Stephan; Kuhlmann, Marco; Miyao, Yusuke; Zeman, Daniel; Flickinger, Dan; Hajič, Jan; Ivanova, Angelina & Zhang, Yi (2014). SemEval 2014 Task 8: Broad-Coverage Semantic Dependency Parsing, In Preslav Nakov & Torsten Zesch (ed.),  Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014).  Association for Computational Linguistics.  ISBN 978-1-941643-24-2.  Chapter.  s 63 - 72
• Flickinger, Dan; Bender, Emily & Oepen, Stephan (2014). Towards an Encyclopedia of Compositional Semantics: Documenting the Interface of the English Resource Grammar, In Nicoletta Calzolari; Khalid Choukri; Thierry Declerck; Hrafn Loftsson; Bente Maegaard; Joseph Mariani; Asuncion Moreno; Jan Odijk & Stelios Piperidis (ed.),  Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14).  European Language Resources Association.  ISBN 978-2-9517408-8-4.  Chapter.  s 875 - 881
• Lapponi, Emanuele; Velldal, Erik; Oepen, Stephan & Knudsen, Rune Lain (2014). Off-Road LAF: Encoding and Processing Annotations in NLP Workflows, In Nicoletta Calzolari; Khalid Choukri; Thierry Declerck; Hrafn Loftsson; Bente Maegaard; Joseph Mariani; Asuncion Moreno; Jan Odijk & Stelios Piperidis (ed.),  Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14).  European Language Resources Association.  ISBN 978-2-9517408-8-4.  artikkel.  s 4578 - 4584
• Høyland, Bjørn; Godbout, Jean-François; Lapponi, Emanuele & Velldal, Erik (2014). Predicting Party Affiliations from European Parliament Debates, In Cristian Danescu-Niculescu-Miz; Jacob Eisenstein; Kathleen McKeown & Noah Smith (ed.),  Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science.  Association for Computational Linguistics.  ISBN 978-1-941643-10-5.  artikkel.  s 56 - 60
• Kouylekov, Milen & Oepen, Stephan (2014). Semantic Technologies for Querying Linguistic Annotations: An Experiment Focusing on Graph-Structured Data, In Nicoletta Calzolari; Khalid Choukri; Thierry Declerck; Hrafn Loftsson; Bente Maegaard; Joseph Mariani; Asuncion Moreno; Jan Odijk & Stelios Piperidis (ed.),  Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14).  European Language Resources Association.  ISBN 978-2-9517408-8-4.  Article. Full text in Research Archive.
• Kouylekov, Milen & Oepen, Stephan (2014). RDF Triple Stores and a Custom SPARQL Front-End for Indexing and Searching (Very) Large Semantic Networks, In Lamia Tounsi & Rak Rafal (ed.),  Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: System Demonstrations.  Association for Computational Linguistics.  ISBN 978-1-941643-27-3.  Article.  s 90 - 94
• Lien, Elisabeth & Kouylekov, Milen (2014). UIO-Lien: Entailment Recognition using Minimal Recursion Semantics, In Preslav Nakov & Torsten Zesch (ed.),  Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014).  Association for Computational Linguistics.  ISBN 978-1-941643-24-2.  Artikkel.  s 699 - 703 Full text in Research Archive.
• Lien, Elisabeth (2014). Using Minimal Recursion Semantics for Entailment Recognition, In Shuly Wintner; Desmond Elliott; Konstantina Garoufi; Douwe Kiela & Ivan Vulić (ed.),  Proceedings of the Student Research Workshop at the 14th Conference of the European Chapter of the Association for Computational Linguistics.  Association for Computational Linguistics.  ISBN 978-1-937284-80-0.  Artikkel.  s 76 - 84 Full text in Research Archive.
• Skjærholt, Arne (2014). A chance-corrected measure of inter-annotator agreement for syntax, In Kristina Toutanova & Hua Wu (ed.),  Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.  Association for Computational Linguistics.  ISBN 978-1-937284-72-5.  Artikkel.  s 934 - 944 Show summary

  Following the works of Carletta (1996) an Artstein and Poesio (2008), there is an increasing consensus within the field that in order to properly gauge the reliability of an annotation effort, chance-corrected measures of inter-annotator agreement should be used. With this in mind, it is striking that virtually all evaluations of syntactic annotation efforts use uncorrected parser evaluation metrics such as bracket F1 (for phrase structure) and accuracy scores (for dependencies). In this work we present a chance-corrected metric based on Krippendorff’s α, adapted to the structure of syntactic annotations and applicable both to phrase structure and dependency annotation without any modifications. To evaluate our metric we first present a number of synthetic experiments to better control the sources of noise and gauge the metric’s responses, before finally contrasting the behaviour of our chance-corrected metric with that of uncorrected parser evaluation metrics on real corpora.

• Packard, Woodley; Bender, Emily; Read, Jonathon; Oepen, Stephan & Dridan, Rebecca (2014). Simple Negation Scope Resolution through Deep Parsing: A Semantic Solution to a Semantic Problem, In Kristina Toutanova & Hua Wu (ed.),  Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.  Association for Computational Linguistics.  ISBN 978-1-937284-72-5.  Chapter.  s 69 - 78
• Kosek, Michal Kajetan & Lison, Pierre (2014). An Intelligent Tutoring System for Learning Chinese with a Cognitive Model of the Learner, In Peppi Taalas (ed.),  Proceedings of EUROCALL 2014.  Research-publishing.net.  ISBN 978-1-908416-19-3.  papers.  s 179 - 184 Show summary

  We present an Intelligent Tutoring System that lets students of Chinese learn words and grammatical constructions. It relies on a Bayesian, linguistically motivated cognitive model that represents the learner’s knowledge. This model is dynamically updated given observations about the learner’s behaviour in the exercises, and employed at runtime to select the exercises that are expected to maximise the learning outcome. Compared with a baseline that randomly chooses exercises at user’s declared level, the system shows positive effects on users’ assessment of how much they have learnt, which suggests that it leads to enhanced learning.

• Ivanova, Angelina & Van Noord, Gertjan (2014). Treelet Probabilities for HPSG Parsing and Error Correction, In Nicoletta Calzolari; Khalid Choukri; Thierry Declerck; Hrafn Loftsson; Bente Maegaard; Joseph Mariani; Asuncion Moreno; Jan Odijk & Stelios Piperidis (ed.),  Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14).  European Language Resources Association.  ISBN 978-2-9517408-8-4.  Parsing.  s 2887 - 2892 Full text in Research Archive.
• Solberg, Per Erik; Skjærholt, Arne; Øvrelid, Lilja; Hagen, Kristin & Johannessen, Janne Bondi (2014). The Norwegian Dependency Treebank, In Nicoletta Calzolari; Khalid Choukri; Thierry Declerck; Hrafn Loftsson; Bente Maegaard; Joseph Mariani; Asuncion Moreno; Jan Odijk & Stelios Piperidis (ed.),  Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14).  European Language Resources Association.  ISBN 978-2-9517408-8-4.  Kapittel.  s 789 - 795 Full text in Research Archive.
• Dridan, Rebecca & Oepen, Stephan (2013). Document Parsing: Towards Realistic Syntactic Analysis, In Harry Bunt; Khalil Sima’an & Liang Huang (ed.),  Proceedings of The 13th International Conference on Parsing Technologies IWPT-2013.  Association for Computational Linguistics.  ISBN 978-1-937284-76-3.  Document Parsing.  s 127 - 133
• Ivanova, Angelina; Oepen, Stephan; Dridan, Rebecca; Flickinger, Dan & Øvrelid, Lilja (2013). On Different Approaches to Syntactic Analysis Into Bi-Lexical Dependencies. An Empirical Comparison of Direct, PCFG-Based, and HPSG-Based Parsers, In Harry Bunt; Khalil Sima’an & Liang Huang (ed.),  Proceedings of The 13th International Conference on Parsing Technologies IWPT-2013.  Association for Computational Linguistics.  ISBN 978-1-937284-76-3.  8. Full text in Research Archive.
• Holen, Gordana Ilic (2013). Critical Reflections on Evaluation Practices in Coreference Resolution, In Annie Louis; Richard Socher; Julia Hockenmaier & Eric K. Ringger (ed.),  Proceedings of the 2013 NAACL HLT Student Research Workshop.  Association for Computational Linguistics.  ISBN 978-1-937284-47-3.  Artikkel.  s 1 - 7

View all works in Cristin

• Oepen, Stephan (ed.) (2017). Proceedings of the 2017 Shared Task on Extrinsic Parser Evaluation at the Fourth International Conference on Dependency Linguistics and the 15th International Conference on Parsing Technologies. Association for Computational Linguistics.  ISBN 978-1-945626-74-6.  99 s.
• Carroll, John; Gojenola, Koldo & Oepen, Stephan (ed.) (2015). Proceedings of the 14th International Conference on Parsing Technologies. Association for Computational Linguistics.  ISBN 978-1-941643-98-3.  129 s.
• Oepen, Stephan; Hagen, Kristin & Johannessen, Janne Bondi (ed.) (2013). Proceedings of the 19th Nordic Conference of Computational Linguistics (NODALIDA 2013). Linköping University Electronic Press.  ISBN 978-91-7519-589-6.  474 s.

View all works in Cristin

• Nooralahzadeh, Farhad & Øvrelid, Lilja (2018). Syntactic Dependency Representations in Neural Relation Classification.
• Lison, Pierre (2016). Hybrid dialogue management + dialogue modelling for MT.
• Lison, Pierre (2016). A short introduction to statistical machine translation. Show summary

  Machine translation (MT) systems such as Google Translate have become part of our daily life. But how do they work? In this talk, I'll explain how these systems are built. In the first part of my talk, I'll present a general overview of the field and the key ideas driving modern MT systems. In the second part, I'll dig deeper into the statistical techniques used to estimate translation models from data, and discuss some of the current hot topics in the field.

• Lison, Pierre (2016). OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. Show summary

  We present a new major release of the OpenSubtitles collection of parallel corpora. The release is compiled from a large database of movie and TV subtitles and includes a total of 1689 bitexts spanning 2.6 billion sentences across 60 languages. The release also incorporates a number of enhancements in the preprocessing and alignment of the subtitles, such as the automatic correction of OCR errors and the use of meta-data to estimate the quality of each subtitle and score subtitle pairs.

• Lapponi, Emanuele; Oepen, Stephan; Skjærholt, Arne & Velldal, Erik (2015). LAP: The CLARINO Language Analysis Portal.
• Fares, Murhaf; Oepen, Stephan & Velldal, Erik (2015). Identifying Compounds: On The Role of Syntax.
• Lison, Pierre (2015). Structured Probabilistic Modelling for Dialogue Management.
• Lison, Pierre & Kennington, Casey (2015). Developing Spoken Dialogue Systems with the OpenDial toolkit.
• Dragone, Paolo & Lison, Pierre (2015). Non-sentential utterances in dialogue: experiments in classification and interpretation.
• Lien, Elisabeth & Kouylekov, Milen (2015). Semantic Parsing for Textual Entailment.
• Lison, Pierre (2014). Structured Probabilistic Modelling for Dialogue Management.
• Lien, Elisabeth & Kouylekov, Milen (2014). UIO-Lien: Entailment Recognition using Minimal Recursion Semantics.
• Lien, Elisabeth (2014). Using Minimal Recursion Semantics for Entailment Recognition.
• Lison, Pierre & Meena, Raveesh (2014). Spoken Dialogue Systems: A New Frontier in Human-Computer Interaction. ACM Crossroads.  ISSN 1528-4972.  21(1)
• Kosek, Michal Kajetan & Lison, Pierre (2014). An Intelligent Tutoring System for Learning Chinese with a Cognitive Model of the Learner.
• Ivanova, Angelina (2014). Treelet Probabilities for HPSG Parsing and Error Correction.
• Lison, Pierre (2014). Structured Probabilistic Modelling for Dialogue Management. Series of dissertations submitted to the Faculty of Mathematics and Natural Sciences, University of Oslo.. 1452. Show summary

  This thesis presents a new modelling framework for dialogue management based on the concept of probabilistic rules. Probabilistic rules are defined as if...then...else constructions associating logical conditions on input variables to probabilistic effects over output variables. These rules function as high-level templates for the generation of a directed graphical model. Their expressive power allows them to represent the probabilistic models employed in dialogue management in a compact and efficient manner. As a consequence, they can drastically reduce the amount of interaction data required for parameter estimation as well as enhance the system's ability to generalise over unseen situations. Furthermore, probabilistic rules can also be exploited to encode domain-specific constraints and assumptions into statistical models of dialogue, thereby enabling system designers to incorporate their expert knowledge of the problem structure in a concise and human-readable form. Due to their integration of logical and probabilistic reasoning, we argue that probabilistic rules are particularly well suited to devise hybrid models of dialogue management that can account for both the complexity and uncertainty that characterise many dialogue domains. The thesis also demonstrates how the parameters of probabilistic rules can be efficiently estimated using both supervised and reinforcement learning techniques. In the case of supervised learning, the rule parameters are learned by imitation on the basis of small amounts of Wizard-of-Oz data. Alternatively, rule parameters can also be optimised via trial and error from repeated interactions with a (real or simulated) user. Both learning strategies rely on Bayesian inference to iteratively estimate the parameter values and provide the best fit for the observed interaction data. Three consecutive experiments conducted in a human--robot interaction domain attest to the practical viability of the proposed framework and its advantages over traditional approaches. In particular, the empirical results of a user evaluation with 37 participants show that a dialogue manager structured with probabilistic rules outperforms both purely hand-crafted and purely statistical methods on an extensive range of subjective and objective metrics of dialogue quality. The modelling framework presented in this thesis is implemented in a new software toolkit called Opendial, which is made freely available to the research community and can be used to develop various types of dialogue systems based on probabilistic rules.

• Ivanova, Angelina (2013). Survey on parsing three dependency representations for English.

View all works in Cristin