CENG 425 System Programming
Spring 2007

Most recent announcement: July12

Announcements

Watch this space for the latest updates. Last updated: 12.Temmuz.2007 16:51 Term projects are accesible.

30.Mayıs.2007 19:21 The presentation day for the term projects is June 11, 2007 at 13.00 and possible classroom is A-319..

May 19, 2007 18:38 The possible topics for the term project are given; you should choose one or propose a topic by yourself and send an e-mail to me as soon as possible

1. Bootstraping -- Ahmed Mübin Cevizci

2. Device Drivers in Linux -- Yusuf Soyman

3. Ext2 file system

4. Journalling file systems

5. Kernel Memory Allocator in Linux

6. Low Level Synchronization in Linux

7. MMU

8. Micro Kernel -- Ahmet Yusuf Özgür

9. Monolithic Kernel

10. Mounting File Systems in Linux

11. Operating System and Keyboard

12. Operating System and Mouse

13. Process Scheduling in Linux

14. Page Tables in Linux

15. Page Replacement Policy in Linux

16. Reiserfs file system

17. System Calls in Linux -- Çağatay Yılmaz

18. TLB

19. Virtual Memory in Linux -- Abdulhamit Maboçoğlu

20. Virtual File System -- Filiz Gökçe

May 16, 2007 12:37 The lecture and lab notes for the foorteenth week are published, see Course Schedule section.

May 14, 2007 16:20 The lecture notes for the fourteenth week is published, see Course Schedule section.

May 9, 2007 12:42 The lab notes for the thirteenth week is published, see Course Schedule section.

May 7, 2007 16:23 The lecture notes for the thirteenth week is published, see Course Schedule section.

May 2, 2007 12:16 The lab notes for the twelfth week is published, see Course Schedule section.

April 30, 2007 16:24 The lecture notes for the twelfth week is published, see Course Schedule section.

April 24, 2007 17:20 There will be no lab study for this week since I am not in the department.

April 18, 2007 11:58:59 The lab notes for the nineth week is published, see Course Schedule section.

April 16, 2007 16:37 The lecture notes for the nineth week is published, see Course Schedule section.

April 9, 2007 16:42 The lecture and lab notes for the eight week is published, see Course Schedule section.

April 3, 2007 15:57 There will be an extra lab hour on Friday (6/4/2007) at 15.30.

March 28, 2007 11:16 There will be leccturing hour today instead of lab study. ATTENDENCY will be the most important factor for your final grade!

March 26, 2007 16:10 The lecture and lab notes for the seventh week is published, see Course Schedule section.

March 19, 2007 15:53 The lecture and lab notes for the sixth week is published, see Course Schedule section.

March 12, 2007 10:35 The lecture and lab notes for the fifth week is published, see Course Schedule section.

March 4, 2007 16:41 The lecture and lab notes for the fourth week is published, see Course Schedule section.

February 25, 2007 17:45 The lecture and lab notes for the third week is published, see Course Schedule section.

February 19, 2007 17:07 Lecture and lab hours are rearranged, see the time table above. There will be class tomorrow. Send me e-mail for the schedule related problems.

February 19, 2007 10:37 The time table will be rescheduled. The present situation is given above and needs further progress. The lecture notes for the second week is published, see Course Schedule section.

• For laboratory studies, the codes in the book and some other codes will be reexamined.

• Anyone wants to get KNOPPIX live cd , download from local server or may ask to room 308.

Overview

It is aimed to describe the concepts of the system programming by using Linux/Unix operating system.

• C programming language will be used

• The concepts described in the Operating Systems course will be studied in detail with applications

• Students will be familiar with the Unix based operating systems

Lecture Information

There is one group for lecturing and one group for lab sessions. The UNIX operating system will be introduced to you first in the lab sessions , later some concepts of the system programming by using Linux/Unix operating system will be studied by C codes and you will be responsible for writing codes, to be graded.

Important announcements will be posted to the Announcements section of this web page above, so please check this page frequently. You are responsible for all such announcements, as well as announcements made in lecture.

Course Outline

• Contents

• List of Tables

• List of Figures

• Getting Started

  • Compiling with GCC

    • Compiling a Single Source File

    • Optimization Options

    • Linking Object Files

    • Common Command-line Options

    • Error Checking and Warnings

  • Automating the Process with GNU Make

  • Debugging with GNU Debugger (GDB)

    • Compiling with Debugging Information

    • Running GDB

  • Finding More Information

    • Man Pages

    • Header Files

  • SYSTEMS PROGRAMMING LABORATORY I - Getting Started

• Writing Good GNU/Linux Software

  • Interaction With the Execution Environment

    • GNU/Linux Command-Line Conventions

    • Using getopt_long

    • Standard I/O

    • Program Exit Codes

    • The Environment

    • Using Temporary Files

  • Coding Defensively

    • Errors and Resource Allocation

  • Writing and Using Libraries

    • Archives

    • Shared Libraries

    • Library Dependencies

    • Pros and Cons

  • SYSTEMS PROGRAMMING LABORATORY II - Writing Good GNU/Linux Software

• Introduction to Shell Programming

  • What is Linux Shell?

  • What is Shell Script ?

  • Getting started with Shell Programming

    • How to write shell script

    • Variables in Shell

    • Shell Arithmetic

    • Exit Status

    • The read Statement

    • Why Command Line arguments required

    • Redirection of Standard output/input

  • Shells (bash) structured Language Constructs

    • Decision making

    • Loops

    • How to de-bug the shell script?

  • Advanced Shell Scripting Commands

    • Local and Global Shell variable (export command)

    • Conditional execution i.e. and

    • User Interface and dialog utility

    • Dialog Utility

    • getopts command

  • SYSTEMS PROGRAMMING LABORATORY III - Introduction to Shell Programming

    • Examples&Exercises:

• Processes

  • Looking at Processes

    • Process IDs

    • Viewing Active Processes

    • Killing a Process

  • Process Control

    • Attributes

  • Creating Processes

    • Using system and popen

    • Using fork and exec

    • Using clone

    • Process Scheduling

  • Signals

  • Process Termination

    • Waiting for Process Termination

    • The wait System Calls

    • Zombie Processes

    • Cleaning Up Children Asynchronously

  • SYSTEMS PROGRAMMING LABORATORY IV - Processes

    • Examples&Exercises:

• Threads

  • Thread Creation

    • Passing Data to Threads

    • Joining Threads

    • Thread Return Values

    • Thread Attributes

  • Thread Cancellation

    • Synchronous and Asynchronous Threads

    • Uncancelable Critical Sections

  • Thread-Specific Data

  • Synchronization and Critical Sections

    • Race Conditions

    • Mutexes

    • Mutex Deadlocks

  • SYSTEMS PROGRAMMING LABORATORY V - Threads I

    • Examples&Exercises:

    • Semaphores for Threads

  • Linux Thread Implementation

  • Processes Vs. Threads

• Interprocess Communication

  • Shared Memory

    • Fast Local Communication

    • The Memory Model

    • Allocation

    • Attachment and Detachment

    • Controlling and Deallocating Shared Memory

  • Processes Semaphores

    • Allocation and Deallocation

    • Initializing Semaphores

    • Wait and Post Operations

  • Mapped Memory

    • Mapping an Ordinary File

  • Pipes

    • Communication Between Parent and Child Processes

    • Redirecting the Standard Input, Output, and Error Streams

  • FIFOs

  • SYSTEMS PROGRAMMING LABORATORY VI - Threads II & IPC

    • Examples&Exercises:

  • Sockets

    • Socket Concepts

    • System Calls

    • Servers

    • Local Sockets

    • An Example Using Local Namespace Sockets

    • Internet-Domain Sockets

  • Devices

  • Device Types

  • Device Numbers

  • Device Entries

    • The /dev Directory

    • Accessing Devices by Opening Files

  • Hardware Devices

  • Special Devices

    • /dev/null

    • /dev/zero

    • /dev/full

    • Random Number Devices

    • Loopback Devices

  • ioctl

  • SYSTEMS PROGRAMMING LABORATORY VI - IPC II & Devices

    • Examples&Exercises:

• Device Drivers

  • The Role of the Device Driver

  • Splitting the Kernel

    • Loadable Modules

  • Classes of Devices and Modules

    • Character devices

    • Block devices

    • Network interfaces

    • Building and Running Modules

  • The Hello World Module

  • Kernel Modules Versus Applications

    • Concurrency in the Kernel

    • A Few Other Details

  • Compiling and Loading

    • Compiling Modules

    • Loading and Unloading Modules

  • The Kernel Symbol Table

  • SYSTEMS PROGRAMMING LABORATORY VIII - Device Drivers

    • Examples&Exercises:

• Linux System Calls

  • Using strace

  • access: Testing File Permissions

  • fcntl: Locks and Other File Operations

  • fsync: Flushing Disk Buffers

  • getrlimit and setrlimit: Resource Limits

  • getrusage: Process Statistics

  • The mlock Family: Locking Physical Memory

  • mprotect: Setting Memory Permissions

  • readlink: Reading Symbolic Links

  • sysinfo: Obtaining System Statistics

  • uname

• Inline Assembly Code

  • When to Use Assembly Code

  • Simple Inline Assembly

    • Converting an asm to Assembly Instructions

  • Example

  • SYSTEMS PROGRAMMING LABORATORY IX - Linux System Calls & Inline Assembly Code

    • Examples&Exercises:

• The /proc File System

  • Extracting Information from /proc

  • Process Information

    • /proc/self

    • Process Argument List

    • Process Environment

    • Process Executable

    • Process File Descriptors

    • Process Memory Statistics

  • Hardware Information

    • Kernel Information

    • Drives, Mounts, and File Systems

  • System Statistics

• Secure Programming

  • Types of Applications

  • Users and Groups

  • Process User IDs and Process Group IDs

  • File System Permissions

  • Security Hole: Programs Without Execute Permissions

    • Sticky Bits

  • Real and Effective IDs

    • Setuid Programs

  • More Security Holes

    • Buffer Overruns

    • Race Conditions in /tmp

    • Using system or popen

  • SYSTEMS PROGRAMMING LABORATORY X - The /proc File System & Secure Programming

    • Examples&Exercises:

• Programming the User Interface

  • Terminal Control the Hard Way

    • Controlling Terminals

    • Using the Terminal Interface

    • Changing Terminal Modes

    • Using terminfo

  • Screen Manipulation with ncurses

    • About Windows

    • Illustrating ncurses Initialization and Termination

    • Input and Output

  • X Window Programming

    • The Xlib API

    • A Sample Xlib Program

    • The X Toolkit API

  • Creating Graphical Interfaces

  • KDE and Qt

    • The Software Levels

    • About Qt

    • About KDE

    • Events Happen

    • The Names of Things

  • Creating and Displaying a Window

    • Hello Qt

    • Hello KDE

• References:

  • vita

• About this document ...

Text Book

Required

Recommended

Mark Mitchell, Jeffrey Oldham, and Alex Samuel, Advanced Linux Programming, New Riders, 2001.

Online References

The web page www.advancedlinuxprogramming.com contains all the information related with the text book.

Grading Criteria

• There will be final exam, will count 50% of your grade.

• Attendance is required and constitutes part of your course grade; 10%

• You are supposed to prepare term report describing the concepts in the context of the course, weighting %40 of your grade.

Policies

• Attendance is not compulsory, but you are responsible for everything said in class.

• I encourage you to ask questions in class. You are supposed to ask questions. Don't guess, ask a question!

• You may discuss homework problems with classmates (although it is not to your advantage to do so).

• You can use ideas from the literature (with proper citation).

• You can use anything from the textbook/notes.

• The code you submit must be written completely by you.

Course Schedule

The following schedule is tentative; it may be updated later in the semester, so check back here frequently.

Week	Dates	Topic	Lecture Notes Acrobat		Laboratory Studies
Lectures
1	February 16, 2007	First Meeting	NA		NA
2	February 19, 2007	Getting Started	pdf		html		pdf
3	February 26, 2007	Writing Good GNU/Linux Software	pdf		html		pdf
4	March 5, 2007	Introduction to Shell Programming	pdf		html		pdf
5	March 12, 2007	Processes	pdf		html		pdf
6	March 19, 2007	Threads	pdf		html		pdf
7	March 26, 2007	Threads & Interprocess Communications	pdf		html	pdf
9	April 9, 2007	Interprocess Communications & Devices	pdf		html		pdf
10	April 16, 2007	Device Drivers	pdf		html		pdf
11	April 23, 2007	National Independence and Children's Holiday	NA		No		Lab
12	April 30, 2007	System Calls & Inline Assembly Code	pdf		html		pdf
13	May 7, 2007	The /proc File System Secure Programming	pdf		html		pdf
14	May 14, 2007	Programming the User Interface I & II	pdf	pdf	html		pdf
Exams
Midterm	Term Project
Final	28.05.2007 B-307 16:30-18:30