CIS 391 - Artificial Intelligence
Winter 2011


COURSE STRUCTURE
* MODULES AND NOTES * ASSIGNMENTS * RESOURCES

Instructor
Mitch Marcus
Levine 503, 215-898-2538
mitch (AT) cis.upen.edu
Office Hours: Mon 4:30-6 & by appointment (e-mail).

Course Administrator
Cheryl Hickey
Levine 502, 215-898-3538
cherylh (AT) cis.upen.edu
Teaching Assistants
Ryan Kennedy
Levine 471
kenry (AT) cis.upenn.edu
Office Hours: Tuesday 11:30-1:30 in Levine 512.

Qiuye Zhao
Levine 514
qiuye (AT) seas.upen.edu
Office Hours: TBD

Class Schedule:Monday-Wednesday-Friday, 11am to 12pm, Towne 309

Artificial Intelligence is considered from the point of view of a resource-limited knowledge-based agent who must reason and act in the world. Topics include search, knowledge representation and reasoning, probabilistic reasoning, machine learning, logic, automatic theorem proving, and natural language processing. Programming assignments in Python.

Prerequisites: CIS 121

COURSE STRUCTURE


Web Page:
http://www.seas.upenn.edu/~cis391/

Textbook:
Artificial Intelligence: A Modern Approach
(Third Edition) 2009
Stuart Russell and Peter Norvig
Prentice Hall Series in Artificial Intelligence
Grading:
40% Homeworks (Final project will count for 1/4 of that amount)
30% Midterm 1
30% Midterm 2
Homework:
Homework will be due at 11:00 a.m. on specified dates
Late homeworks will be penalized unless an extension has been granted in advance :
-- 15% reduction if 0-24 hours late
-- 30% reduction if handed in at the following class
-- 45% reduction if handed in two classes later
-- no credit if more than a week late


Back to Top

CLASS MODULES


Links to classroom slides will appear below.

Lecture Notes are in PDF format.


Module 0: Introduction 
AIMA Textbook: Chapters 1-2
  • Introduction
    • 1/12   Introduction to Artificial Intelligence [(pdf) (6-up)] ( AIMA, Chapter 1)
    • 1/14   Intelligent Agents [(pdf) (6-up)] ( AIMA, Chapter 2)
  • Python Programming
    • Readings: Slides should be sufficient. See Resources for additional materials, including on-line Python library reference and on-line books.
    • 1/19  Python Review [(pdf)  (6-up)]   Much more thorough Python tutorial [(pdf) (6-up)]

Module 1: Search AIMA Textbook: Chapters 3-6
  • Search
    • 1/24  Uninformed Search [(pdf)  (6-up)] (AIMA 3.1-3.4)
    • 1/26  Uninformed Search Part II [(pdf)  (6-up)]
    • 1/28  Uninformed Search Part II Final Version[(pdf)  (6-up)]
    • 1/31   Informed Search Part 1 [(pdf) (6-up)] (AIMA 3.5.1, 3.5.2)
    • 2/2  Informed Search Part 2 [(pdf) (6-up)] (AIMA 3.6)
    • 2/4   Local Search [(pdf) (6-up)] (AIMA 4.1 (skipping the rest of Chapter 4))
    • 2/6   Genetic Algorithms [(pdf) (6-up)]
  • Adversarial Search
    • 2/7  2-Player Games: Adversarial Search Part 1 [(pdf) (6-up)] (AIMA 5.1)
    • 2/9  2-Player Games: Adversarial Search Part 2 [(pdf) (6-up)] (AIMA 5.2,5.3)
  • Constraint Satisfaction
    • 2/11  Interpreting Line Drawings: Intro to Constraint Satisfaction [(pdf) (6-up)] (AIMA 6.1(roughly), 6.2)
    • 2/11  Handout: The Huffman-Clowes Labelling Set [(pdf)]
    • 2/14 Constraint Satisfaction More Generally [(pdf) (6-up)] (AIMA 6.3,6.4)

Module 2A: Machine Learning and Natural Language Processing

  • Introduction to Probability
    • 2/18  Uncertainty & Probability [(pdf) (6-up) ] (AIMA 13.1-13.5)
  • Naive Bayes & Spam Filtering
    • 2/23   Naive Bayes/Spam Filtering [(pdf) (6up)] (AIMA 22.2)
  • Bayesian Networks
    • 2/25   Bayes Nets [(pdf) (6up)] (AIMA 14.1-14.2)

Midterm I: Monday, Feb. 28th.

  • Last year's midterm with solutions is available here
  • 2/25  Review Slides for Midterm [(pdf) (6up))]

Module 2B: Machine Learning and Natural Language Processing

  • 3/02   Perceptrons and SVMs [(pdf) (6up)]
  • 3/04   Intro to NLP [(pdf)]
  • (Spring Break)
  • 3/14   Language models and Markov Models [(pdf) (6up)]
    (some topics covered in AIMA 15.2; Markov Models in Jurafsky & Martin, Speech and Language Processing, 4.1-4.3; Smoothing in J & M Chap. 4.5 Intro and 4.5.1)
  • 3/16-3/23   Part of Speech Tagging and Hidden Markov Models [(pdf) (6up)] (some topics covered in AIMA 15.3. Good discussion in J&M, 5.1, 5.2, 5.5)
  • 3/25   Speech Recognition [(pdf) (6up)] (parallel treatment in AIMA 23.5)
  • 3/28   Information Theory and Feature Selection [(pdf) (6up)] (Expands topic in AIMA 18.3)
  • 3/30-4/4  Decision Trees [(pdf) (6up)] (AIMA 18.1-18.3)

Module 3: Knowledge Representation and Logic

  • 4/6  Logical Agents /& Propositional Logic [(pdf) (6up)] (AIMA 7.1-7.4)
  • 4/8  Inference Methods for Propositional Logic I [(pdf) (6up)]
  • 4/13   First Order Logic [ (pdf) ] [ (6up) ](AIMA 8.1-8.3)
  • 4/18   Inference in First Order Logic [ (pdf) ] [ (6up) ](AIMA 9.1-9.2,9.5)

Midterm II - LAST CLASS: MONDAY, APRIL 25

Back to Top

HOMEWORK ASSIGNMENTS

PDF Files require Adobe Acrobat Reader
DOC Files require Microsoft Word or Open Office
 
  • Homework 1 - Due Wed., Feb. 2, 2011. Emailing your solutions to Ryan Kennedy is fine.
    You can find the encrypted file vfd.txt for the homework here. (Right click and then use "Save Link As..." or "Save Target As.." to save it...)
  • Homework 2 - Due Wed., Feb 16, 2011. You may email the TA or hand in a hard copy of non-coding problems, but email any code to the TA. The code for the last question can be found here.

  • Homework 3 - Problems 1,2 due Wed., March 2nd. Problems 3-6 due Wed., March 16th. The sudoku problems to test on can be found here.

  • Homework 4 - Due Wed. April 6th. The code for this problem can be found here and the dataset can be found here.

  • Final project - Due Wed. April 27th. The code for the final project can be found here.


Back to Top

OTHER RESOURCES

Python Resources

Textbook Resources

Website for: Artificial Intelligence: A Modern Approach
(http://aima.cs.berkeley.edu/)
 


Back to Top


For more information, please contact mitch (AT) cis.upenn.edu