and Prospects for Consciousness Stuart C Shapiro Department of Computer Science amp Engineering and Center for Cognitive Science State University of New York at Buffalo shapirobuffaloedu ID: 1044207
Download Presentation The PPT/PDF document "The GLAIR Cognitive Architecture" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
1. The GLAIR Cognitive Architectureand Prospects for ConsciousnessStuart C. ShapiroDepartment of Computer Science & Engineering and Center for Cognitive ScienceState University of New York at Buffaloshapiro@buffalo.edu
2. OutlineOverviewIntegration of Acting and ReasoningSymbol GroundingTimeCSE 719S. C. Shapiro2
3. Cognitive Architecture“A cognitive architecture specifies the underlying infrastructure for an intelligent system[, including] those aspects of a cognitive agent that are constant over time and across different application domains.”[P. Langley, J. E. Laird, S. Rogers, Cognitive architectures: Research issues and challenges, Cognitive Systems Research 10 (2009) 141-160.]CSE 719S. C. Shapiro3
4. Grounded Layered Architecture with Integrated ReasoningMajor Concern:Knowledge Representation and ReasoningDriving Motivation:Natural Language Understanding & GenerationAdditional Concern:Agents that actQuestion:Where do beliefs come from?Partial Answer:Agent’s being embodiedAgent’s being situated in the worldCSE 719S. C. Shapiro4
5. CSE 719S. C. Shapiro5KLPMLaPMLbPMLcSALMindBodyIndependentof lower-bodyimplementationHearingVisionMotionSpeechWORLD I/P s o c k e t sGLAIR ArchitectureDependenton lower-bodyimplementationProprioception
6. Sensori-Actuator LayerSensor and effector controllersCSE 719S. C. Shapiro6
7. Perceptuo-Motor LayerPMLaPMLbPMLcCSE 719S. C. Shapiro7
8. PMLcAbstracts sensors & effectorsBody’s behavioral repertoireCSE 719S. C. Shapiro8
9. PMLbTranslation & CommunicationBetween PMLa & PMLcHighest layer that knows body implementationCSE 719S. C. Shapiro9
10. PMLaGrounds KL symbolsPerceptual structuresImplementation of primitive actionsRegisters for Embodiment & SituatednessDeictic RegistersModality RegistersCSE 719S. C. Shapiro10
11. The Knowledge LayerImplemented in SNePSAgent’s BeliefsRepresentations of conceived of entitiesSemantic MemoryEpisodic MemoryQuantified & conditional beliefsPlans for non-primitive actsPlans to achieve goalsBeliefs re. preconditions & effects of actsPolicies: Conditions for performing actsSelf-knowledgeMeta-knowledgeCSE 719S. C. Shapiro11
12. OutlineOverviewIntegration of Acting and ReasoningSymbol GroundingTimeCSE 719S. C. Shapiro12
13. SNePSA KRR systemEvery non-atomic expression is simultaneouslyAn expression of SNePS logicAn assertional frameA propositional graphEvery SNePS expression is a termDenoting a mental entityCSE 719S. C. Shapiro13
14. Ontology of Mental EntitiesEntityPropositionAgent can believe it or its negationIncludes quantified & conditional beliefsActAgent can perform itPolicyCondition-act rule agent can adoptThingOther entities: individuals, categories, properties, etc.CSE 719S. C. Shapiro14
15. PoliciesReasoning ActingForward Reasoningwhendo(φ, α)wheneverdo(φ, α)Backward Reasoningifdo(φ, α)CSE 719S. C. Shapiro15
16. Types of Acts IExternal Actsaffect the environmentsupplied by agent designerMental Actsaffect the knowledge layerbelieve, disbelieveadopt, unadoptControl Actssequence, selection, loop, etc.CSE 719S. C. Shapiro16
17. Types of Acts IIPrimitive ActsImplemented in PMLaComposite ActsStructured by control actsDefined ActsDefined by ActPlan(α, p) beliefCSE 719S. C. Shapiro17
18. Acting ReasoningControl Actssnif({if(φ1, α1), …, if(φn, αn), [else(δ)]})sniterate({if(φ1, α1), …, if(φn, αn), [else(δ)]})withsome(x, φ(x), α(x), [δ])withall(x, φ(x), α(x), [δ])CSE 719S. C. Shapiro18
19. Goal TalkGoalPlan(φ, p) achieve(φ) CSE 719S. C. Shapiro19
20. S. C. ShapiroBehavior CycleEnglish(Statement, Question, Command)(Current) Set of Beliefs(Updated) Setof BeliefsActions(New Belief)English sentence expressingnew belief answering question reporting actionsAnswerNL AnalysisNL GenerationReasoningClarification DialogueLooking in WorldReasoningCSE 71920
21. OutlineOverviewIntegration of Acting and ReasoningSymbol GroundingTimeCSE 719S. C. Shapiro21
22. S. C. ShapiroFEVAHR/Cassie in the LabCSE 71922
23. S. C. ShapiroEntities, Terms, Symbols, ObjectsAgent’s mental entity: a person named StuSNePS term: b4Object in world:23BICA 2009
24. S. C. ShapiroAlignmentMind (KL)Body (PML/SAL)WorldKL termPML structureObject/PhenomenonActionCSE 71924
25. World Objectsto Feature Tuples<Height, Width, Texture, . . . >WorldPML/SAL25S. C. ShapiroCSE 719
26. Feature Tuplesto KL Terms<Height, Width, Texture, . . . >PML/SALKLProperName(b4, Stu)AlignmentCSE 71926S. C. Shapiro
27. Incomplete PML-Descriptions<Height, nil, nil, . . . >PML/SALKLHeight(b4, b12)CSE 71927S. C. Shapiro
28. Unifying PML-Descriptions<x, nil, nil, ... >PML/SALKLb20b30b31b6<nil, y, nil, ... ><nil, nil, z, ... ><x, y, z, ... >IsaPropProp28CSE 719S. C. Shapiro
29. Deictic RegistersFor being situated in the worldPML registers hold KL termsI term denoting agentYOU term denoting dialogue partnerNOW term denoting current timeCSE 719S. C. Shapiro29
30. Modality RegistersFor privileged first-person knowledge of what agent is doingRegister for each modality holdsKL term denoting act modality is engaged inCSE 719S. C. Shapiro30
31. S. C. ShapiroActing 1CSE 71931
32. S. C. ShapiroActing 2I found a red robot.I am looking at a red robot.Follow a red robot.CSE 71932
33. S. C. ShapiroActing 3I went to a red robot.I am near a red robot.I am following a red robot.I found a red robot.I am looking at a red robot.Follow a red robot.CSE 71933
34. S. C. ShapiroUse of Indexicals 1Come here.I found you.I am looking at you.CSE 71934
35. S. C. ShapiroCome here.I came to you, Stu.I am near you.Use of Indexicals 2I found you.I am looking at you.CSE 71935
36. S. C. ShapiroWho am I?Your name is ‘Stu’and you are a person.Who have you talked to?I am talking to you.Talk to Bill.I am talking to you, Bill.Come here.Use of Indexicals 3CSE 71936
37. S. C. ShapiroCome here.I found you.I am looking at you.Use of Indexicals 4CSE 71937
38. S. C. ShapiroCome here.I came to you.I am near you.I found you.I am looking at you.Use of Indexicals 5CSE 71938
39. S. C. ShapiroWho am I?I talked to Stuand I am talking to you.Your name is ‘Bill’and you are a person.Who are you?I am the FEVAHRand my name is ‘Cassie’.Who have you talked to?Use of Indexicals 6CSE 71939
40. <green, nil>PML/SALKLb20b30b6<nil, robotic>IsaProp40CSE 719S. C. Shapirom2Find a green robot.(find )cassiem75m76robbie <green, robotic>VISIONLanguage-Mind-World-MindWORLD
41. OutlineOverviewIntegration of Acting and ReasoningSymbol GroundingTimeCSE 719S. C. Shapiro41
42. B6Representation of TimefindlexactionobjectB1!agentacteventtimeNOW!!beforeafterbeforeafter?????????????ICSE 71942S. C. Shapiro
43. Building Episodic MemoryCSE 719S. C. Shapiro43KLPMLe1Ia1b1!t1e2a2!t2!NOWCOUNTnhom0q!beforeaftereventeventtimetimetimeactactagentagentdurationACT
44. Performing a Punctual Actt1t3!beforeafterNOWNOWCSE 71944S. C. Shapirot2!beforeafter!timeevent
45. Performing a Durative Actt1NOWt3!supintsubintCSE 71945S. C. ShapiroNOW!beforeaftert2!timeevent
46. Aligning NOW using MTFNOWSemi-lattice of times, all of which contain *NOW,any of which could be meant by “now”Finite---only conceptualized times of conceptualized statesMaximal Temporal Frame based on *NOWKLPMLCSE 71946S. C. Shapiro
47. Moving NOW with MTFNOWKLPMLMoves when Cassie acts, newly observes a state,or is informed of a new state. Always includes times of states in modality registers.CSE 71947S. C. Shapiro
48. CSE 719S. C. Shapiro48CollaboratorsPast and present members ofSNeRG: The SNePS Research Grouphttp://www.cse.buffalo.edu/sneps/