/
Specifying modalities in the Specifying modalities in the

Specifying modalities in the - PowerPoint Presentation

sophia2
sophia2 . @sophia2
Follow
65 views
Uploaded On 2023-11-20

Specifying modalities in the - PPT Presentation

mglair architecture Stuart C Shapiro and Jonathan P Bona Department of Computer Science and Engineering And Center for Cognitive Science University at Buffalo The State University of New York ID: 1033484

shapiro amp formal magic amp shapiro magic formal bona 2013s modality act body modalities agent perceptual afferent layer sensing

Share:

Link:

Embed:

Download Presentation from below link

Download Presentation The PPT/PDF document "Specifying modalities in the" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript

1. Specifying modalities in the mglair architecture Stuart C. Shapiro and Jonathan P. BonaDepartment of Computer Science and EngineeringAnd Center for Cognitive ScienceUniversity at Buffalo, The State University of New York

2. OutlineThe ArchitectureSpecifying Modalities7/31/20132S. C. Shapiro & J. P. Bona Formal MAGIC 2013

3. Motivations for MGLAIR Add acting and sensing to a reasoning agent.First person reasoning; on-line acting & sensing.LayersMotivated by mind/body connections/distinctions.Let same mind be plugged into different bodies.EmbodimentOrigin of beliefs in sensation & proprioception.First-person privileged knowledge of own body.SituatednessHas a sense of where it is in the world.Symbol groundingIn body-layer structures.Symbol as pivot between various modalities.7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 20133

4. Motivations for ModalitiesIndependent but limited resourcesSensors and effectors are the resourcesDifferent modalities can be used independentlySingle modality has limited use7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 20134

5. MGLAIR Architecture7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 20135

6. Sensori-Actuator LayerSensor and effector controllers7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 20136

7. Perceptuo-Motor LayerPMLaPMLsPMLbPMLc7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 20137

8. PMLcAbstracts sensors & effectorsBody’s behavioral repertoireSpecific to body implementation7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 20138

9. PMLbTranslation & CommunicationBetween PMLa/s & PMLcHighest layer that knowsbody implementation7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 20139

10. PMLsGrounds KL symbolsPerceptual structuresLowest layer that knows KL termsRegisters forEmbodiment & SituatednessDeictic RegistersModality Registers7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201310

11. PMLaGrounds KL symbolsImplementation of primitive actionsLowest layer that knows KL termsRegisters forEmbodiment & SituatednessDeictic RegistersModality Registers7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201311

12. The Knowledge LayerImplemented in SNePSAgent’s BeliefsRepresentations of conceived of entitiesSemantic MemoryEpisodic MemoryQuantified & conditional beliefsPlans for non-primitive actsPlans to achieve goalsBeliefs re. preconditions & effects of actsPolicies: Conditionsfor performing actsSelf-knowledgeMeta-knowledge7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201312

13. Afferent ModalitiesSensorsto Perceptual Structuresto Perceptionto KL Terms7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201313

14. Efferent ModalitiesKL Primitive Actsto PMLa Methodsto act Impulsesto Effectors7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201314

15. Alignment7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201315Mind (KL)Body (PML/SAL)WorldThingPMLs structureObject/PhenomenonActionPMLa methodActionAfferentModalityEfferentModality

16. Entities, Terms, Symbols, ObjectsAgent’s mental entity: a person named StuSNePS term: b4Object in world:7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201316

17. Ontology of Mental EntitiesEntityPropositionAgent can believe it or its negationIncludes quantified & conditional beliefsActAgent can perform itPolicyCondition-act rule agent can adoptThingAction: What some agent can perform on some object(s)Category: A category/class of entitiesOther entities: individuals, properties, times, etc.7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201317

18. Modality: A Nine-Tuple7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201318NameUnique name for modalityTypeafferent/efferentPredicatesKL predicates to useChannelData channelAccessAllow/Deny agent conscious accessFocusDefault level; Permit/Forbid agent adjustment …ConflictConflict handler for multiple use …DescriptionHuman readable descriptionRelationsRelations to other modalities

19. Act Impulses in Efferent ModalitiesKL primitive acts implemented by PMLa methodsPMLa method to be executedadded as act impulse to modality buffer7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201319

20. Efferent Modality BuffersIn PMLb of efferent modalityFixed capacity or expiration intervalNew act impulse queued or replaces old impulseWhen impulse arrives that can’t fit,handled by conflict handlerDiscarded impulses are never performedImpulses removed by buffer management processand processed in PMLc7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201320

21. Perceptual BuffersIn PMLb of afferent modalityQueues perceptual (PML) structures (sensory data)Fixed capacity or expiration intervalWhen structure arrives that can’t fit,either it or oldest structure discardeddepending on conflict handlerDiscarded structures are never perceivedStructures removed by buffer management processand given to perceptual function7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201321

22. Perceptual FunctionsSpecific to each afferent modalityInput: a PML structure representing what was sensedOutput: KL term(s) representing what was perceived7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201322

23. Afferent Modality FocusAffects frequency of execution of internal processesFrom “ignore” to maximal focusInitially at default settingAgent might be permitted to adjustAgent might missperceiving phenomena in low-focused modalitiesSo adjust relative focus of different modalilties appropriatelyWatching the road vs. talking on cell phone!7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201323

24. SummaryMGLAIR adds acting/sensing to reasoning agents.Layers capture Mind/Body distinction & connection.Modalities are independent, limited resourcesfor acting and sensing.Modality buffers queue act impulses & afferent structuresbut discard ones not processed.Focus level determines how much a modality is ignored.7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201324

25. For More Information/Papers/Downloadshttp://www.cse.buffalo.edu/~shapiro/http://www.cse.buffalo.edu/sneps/7/31/2013S. C. Shapiro & J. P. Bona Formal MAGIC 201325