RULE-BASED ARTIFICIAL INTELLIGENCE Creative

slide1. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena AI RAGA
The Rule-Based
Creative Intelligent Expert System
for Indian Music

By
Dr. Vinod Vidwans<br>
slide2. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Artificial Intelligence (AI) is a
discipline that tries to mimic or
simulate human behavior
through machines.

The main objective of this Research
is to show that AI can be used
as a tool to simulate Ragas of
Indian Music.<br>
slide3. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Through simulation of Ragas we
can validate the Science of Indian
Music.

Here an attempt is made to
Validate principles of music
Mentioned in Natyashastra
and Sangita Ratnakara<br>
slide4. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Through simulation of Ragas
Principles such as…
Shruti, Vadi, Samvadi &
Shadja-Panchama Bhava,
Shadja-Madhyama Bhava
and so on…
Which are mentioned in the
Natyashastra and the
Sangita Ratnakara can be
Validated.<br>
slide5. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena AI Paradigms: AI is explored in
variety of ways…
 
Rule-Based Expert Systems
Neural Networks (ANN)
Nature Inspired Computing (NIC)
Genetic Algorithms
Artificial Life
Cellular Automaton
Our focus: Rule-Based AI Expert System<br>
slide6. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Computational Indian Music
- A Brief Review
 
Prof. H. V. Sahasrabuddhe developed
Finite State Automata (FSA) model-1992

He proposed that automatic as well as
computer-assisted composition is possible
with the FSA model. However a complete
generative system has not been
described in his work.<br>
slide7. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Computational Indian Music
  - A Brief Review

Finite State Models For Generation Of
Hindustani Classical Music
By Dipanjan Das and
Monojit Choudhury at IITK- 2005

Computational Musicology in Hindustani Music
Authors: Chakraborty, S., Mazzola, G., Tewari, S.,
Patra, M. – 2014

This book focuses on analysis and not on
music generation.<br>
slide8. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena AI Raga 

Rule-Based Expert System for Indian Music
By Dr. Vinod Vidwans
 
This Rule-Based Creatively Intelligent
Expert System generates a Bandish
(a musical composition) in a given Raga
and renders it in traditional classical style.
It generates Bandish on its own without
any human assistance.<br>
slide9. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena AI Raga 
 
The system is capable of generating
appropriate Alaaps, Taanas and
Swara-Vistar following the rules of Indian
Classical Music.
 
It requires Aroha (ascending order of notes)
and Avaroha (descending order of notes)
along with Vadi (a dominant) and Samvadi
(a sub-dominant) notes of the Raga.<br>
slide10. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena AI Raga 
 
The system keeps generating new
compositions without repeating them.
Presently, the system generates
compositions in artificially created
cSound instruments: Flute, Shehnai,
and Strings like sound
 
The Expert System is developed in
Visual Prolog 5.2. 
More Information at - http://computationalmusic.com/<br>
slide11. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Rule-Based Expert System for Music
A rule-based expert system is one whose
knowledge base contains a data base and
the domain knowledge coded as rules.
 
Knowledge Base or Database
A Set of Rules:
Musical Competence Rules
Musical Performance Rules

Musical Decision Making Engine<br>
slide12. ARTIFICIAL INTELLIGENCE & INDIAN MUSIC Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Rule Based Expert System for Music
Knowledge Base or Database
This system does not have a predefined
database or facts base. On the other hand
the system generates the required data
base for a particular Raga based on the
set of rules. The rules are generic (not
Raga-specific).

This is a generative system.
A major departure from the FSA models
and others.<br>
slide13. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Rule Based Expert System for Music
Knowledge Base or Database

A set of basic element:
Basic units of the domain- Indian music:
12 Swaras and 22 Shrutis
 
ET12= {sa,kre,re,kga,ga,ma,mat,kdha,dha,kni,ni,hsa}
 
ET22= {sa,ckre,kre,bre,re,bga,kga,ga,cma,ma,cmat,
mat,ckdha,kdha,dha,bni,kni,ni,chsa,hsa}<br>
slide14. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Raga Malakauns

From ET12 a subset is selected

M5= {sa,kga,ma,kdha,kni,hsa}
 
All three octaves will be
M53={lsa,lkga,lma,lkdha,lkni , sa,kga,ma,kdha,
kni,hsa,hkga,hma,hkdha,hkni,hhsa}
 
Vadi swara = lma, ma, hma
Samvadi swara = lsa, sa, hsa<br>
slide15. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Raga Malakauns

All permutations and combinations of swaras- Arohi and
Avrohi. Each phrase has two, three and four swaras
 
Swara Phrases Arohi =
{(sa,kga), (kga,ma), (ma,kdha), (kdha,kni), (kni,hsa)…}
{(sa,kga,ma), (kga,ma,kdha), (ma,kdha,kni), (kdha,kni,hsa)…}
 
Swara Phrases Avrohi =
{(hsa,kni), (kni,kdha), (kdha,ma), (ma,kga), (kga,sa)…}
{(hsa,kni,kdha), (kni,kdha,ma), (kdha,ma,kga), (ma,kga,sa)…}
 
Huge database of phrases is generated<br>
slide16. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Raga Malakauns

Apply Alamkara rules to generate Alamkara phrases

{(sa,kga,sa), (kga,ma,kga), (ma,kdha,ma), (kdha,kni,kdha),
(kni,hsa,kni)…}
{(hsa,kni,hsa), (kni,kdha,kni), (kdha,ma,kdha), (ma,kga,ma),
(kga,sa,kga)…}
 
This also may result into variety of phrases like following-
{(sa,ma), (kga, kdha), (ma,kni), (kdha, hsa)…}
{(hsa,hsa), (kni,kni), (kdha, kdha), (ma,ma), (kga, kga)…}
 
These rules are based on traditional Alamkaras or Jatiswaram<br>
slide17. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Raga Malakauns

Apply Second level rules to generate joint phrases of four,
five, six, and seven swaras by joining all the existing phrases.
Join phrases that have last and first swara common.
This may result into interesting phrases as follows-
 
{(sa,ma,kga,ma), (sa,kga,ma,sa,kga,ma)…}
 
Again a huge data base of phrases is generated.<br>
slide18. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Raga Malakauns

Apply advanced rules to select Raga-specific phrases from
this data base. This step is very important. These rules are
based on the concepts from Natyashastra of Bharata. These
Rules are about the role of Vadi, Samvadi, Graha, Nyasa
swaras in the Raga rendering.
 
For instance (sa,ma,kga,ma), (sa,kga,ma,sa,kga,ma)
Both are Raga-specific phrases since they start on samvadi
and end with Vadi.

While (sa,ma,kga,ma,kdha) is valid but NOT Raga-specific
Phrase.<br>
slide19. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Rules, Rules and Rules… Rules for Swara
Rules for Tala
Rules for Bandish Rules for Duration,
frequency, volume,
sonority, ascending
and descending order etc. Rules for Tala
Duration, frequency,
volume, bols, Accent,
rules of composing poetry, 
Rules for Bandish
Dhruva pad, Sthayi, Antara Rules for encoding Tala and Laya:
Druta, Madhya, and Vilambita etc.
 
 Rules for musical instruments
Tanapura, Shehnai, Flute etc.
Instrument-specific encoding Musical Decision Making Musical Aesthetics<br>
slide20. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Musical Decision Making

The system uses the `Generate and Test’
mechanism for musical decision making.
This is based on the work of Herbert
Simon- a Noble laurate and one of the
co-founders of AI .

Noam Chomsky, J. Fodor, Marvin Minsky
and others contributed in establishing the
Domain of Artificial Intelligence.<br>
slide21. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Musical Decision Making

Set of Generative Rules
There are rules that generate the facts or
database required for a Raga.

There are other rules that generate a set
of possible solutions (normally very huge-
it eats up substantial amount of memory
but still affordable).<br>
slide22. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Musical Decision Making

Musical Inference Engine (MIE)
Highly sophisticated Musical
Inference Engine (MIE) is designed and
developed that makes musical inferences.

It decides which rules are satisfied by the
facts, prioritizes them, and executes the rule
with the highest priority.<br>
slide23. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Musical Decision Making

Musical Inference Engine (MIE)
The MIE uses largely the forward chaining
mechanism and prolog mechanism for
inferencing.

Prolog is good at Forward-chaining.
MIE treats each phrase as an event . Based
on that the next phrase is selected.<br>
slide24. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Musical Decision Making

First swara, last swara and presence of
Vadi and Samvadi swara in a phrase are the
Deciding factors.

For {sa,kga,ma} phrase if options are

{ma,kga,sa}, {ma,kdha,ma}, {kdha,kni,kdha}

Then {kdha,kni,kdha} will not be Selected
because it does not have Vadi or Samvadi in it.<br>
slide25. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Musical Decision Making

Forward chaining is reasoning from facts to
the conclusion. In this case for composing
a Bandish for instance the MIE starts
generating chains of swara phrases and
checks if it suits or not and then either
selects or rejects them based on the
musical as well as aesthetic criteria.<br>
slide26. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Musical Decision Making

Bandish structure, number of beats,
catch-phrase of a Raga are some of the
other criteria impacting selection process.

MIE operates in cycles, executing a group
of tasks until certain criteria are satisfied or
causes to halt the execution. Multiple rules
be activated during one cycle.<br>
slide27. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena MIE Mechanism
Depending on the desired Goal, MIE
activates the rules from initial set of rules.

If a rule succeeds with multiple solutions
then all of them are selected for
second round of activation.

Prolog has built-in facility that a rule which
is fired on a fact will not be fired again
and again on the same fact.<br>
slide28. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena MIE Mechanism
The selected solutions are stored
temporarily and the advanced set of rules
is activated for further screening.

Some of the rules are about addition of
facts to the working database, removal
of facts from the working database.

Some other rules are about the musical
criteria for screening. This results into
reducing the number of solutions.<br>
slide29. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena MIE Mechanism
For instance, in the case of Raga Malakauns
Vadi and Samvadi swaras are important.

So the rule is to select phrases starting
with Vadi and Samvadi. Another rule could
be to select phrases that end with a Vadi
swara.

All the phrases satisfying these rules will
be selected. Others will be rejected.<br>
slide30. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena MIE Mechanism
At the third level sophisticated aesthetic
criteria are applied to further narrow
down the number of solutions- preferably
one solution.

If still there are more valid solutions then
one of them is selected randomly.

Currently there are no meta-level rules
in the system.<br>
slide31. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Thus it may be said that theoretical
concepts encoded in ancient treatises
can be empirically verified as well as
can be simulated on the computers

Indian Music is the ideal candidate for
Developments in Artificial Intelligence.

The core concepts of Indian Music from
ancient treatises are relevant for
Contemporary Music too<br>
slide32. RULE-BASED ARTIFICIAL INTELLIGENCE Creative Intelligent Expert System for Indian Music by Dr. Vinod Vidwans Bharat Veena Thanks!
Dr. Vinod Vidwans<br>