Summary
Template Construction Grammar (TCG) is developed as part of an overarching effort to build a system-level neuro-computational model simulating the dynamics at play during language-vision interactions.
TCG offers a computational framework designed to model the human brain’s capacity to dynamically coordinate two concurrent incremental processes, one generating a message and the other organizing its mapping onto a linguistic form.
It also serves to showcase how Schema Theory, and its key tenets of distributed and dynamic cooperative computation, provides guidelines to implement cognitive-level hybrid computational models that operate in the style of the brain.
TCG emerges from an attempt to build a language model that integrates rather than dissects.
The project’s straddles three main fields: neurolinguistics (in particular aphasiology), psycholinguistics, and cognitive linguistics (in particular usage-based construction grammar theories).
Implementation
- The code for TCG is available on GitHub.
- For the latest theoretical outline of the implementation:
TCG Publications
- Barres, Lee (2014). Template Construction Grammar: From visual scene description to language comprehension and agrammatism. Neuroinformatics, 1-28.
- Arbib, Barres (2013). Are grammatical constructions linked to embodied meaning representations? IEEE CIS Autonomous Mental Development Newsletter Fall 2013.
- Lee (2012). Linking eyes to mouth: a schema-based computational model for describing visual scenes. (PhD Thesis). University of Southern California.
- Arbib, Lee (2008). Describing visual scenes: towards a neurolinguistics based on construction grammar. Brain Research, 1225, 146–162.
- Arbib, Lee (2007). Vision and Action in the Language-Ready Brain: From Mirror Neurons to SemRep. In F. Mele, G. Ramella, S. Santillo, & F. Ventriglia (Eds.), Advances in Brain, Vision, and Artificial Intelligence (pp. 104–123). Springer Berlin Heidelberg.
Genesis story
- Itti, Arbib (2006). Attention and the Minimal Subscene.
- Navalpakkam, Arbib, Itti (2005). Attention and Scene Understanding. In Neurobiology of Attention (pp. 197–203). Elsevier.
- Arbib, Hill (1987). Language Acquisition: Schemas Replace Universal Grammar.
- Arbib, Hill, Conklin (1987). From schema theory to language. Oxford University Press.
Web viewer (old!)
here.