Combining machine learning and rule-based approaches in Spanish syntactic generation

Melero Nogués, María Teresa · TDX (Tesis Doctorals en Xarxa) · 2006

Aquesta tesi descriu una gramatica de Generacio que combina regles escrites a ma i tecniques daprenentatge automatic. Aquesta gramatica pertany a un sistema de Traduccio Automatica de qualitat comercial desenvolupat a Microsoft Research. La primera part presenta la gramatica i les principals estrategies linguistiques que aquesta gramatica implementa. Els requeriments de robustesa que reclama lus real del sistema de TA, exigeix del Generador un esforc suplementari que es resol afegint un nivell de pre-generacio, capac de garantir la integritat de lentrada, sense incorporar elements ad-hoc en les regles de la gramatica. A la segona part, explorem lus dels classificadors darbres de decisio (DT) per tal daprendre automaticament una de les operacions que tenen lloc al modul de pre-generacio, en concret la seleccio lexica del verb copulatiu en espanyol (ser o estar). Mostrem que es possible inferir a partir dexemples els contextos per aquest fenomen linguistic no trivial, amb gran precisio. Resumen This thesis describes a Spanish Generation grammar which combines hand-written rules and Machine Learning techniques. This grammar belongs to a full-scale commercial quality Machine Translation system developed at Microsoft Research. The first part presents the grammar and the linguistic strategies it embodies. The need for robustness in real-world situations in the everyday use of the MT system requires from the Generator an extra effort which is resolved by adding a Pre-Generation layer which is able to fix the input to Generation, without contaminating the grammar rules. In the second part we explore the use of Decision Tree classifiers (DT) for automatically learning one of the operations that take place in the Pre-Generation component, namely lexical selection of the Spanish copula (i.e. ser and estar). We show that it is possible to infer from examples the contexts for this non-trivial linguistic phenomenon with high accuracy.

Read the paper · More papers on PaperTik