TOC: Perl Programming

• Preface
  1. Content
• First steps
  1. Installation
  2. Editors
  3. IDEs
  4. Perl on the command line
  5. First script
  6. Safety net
  7. First sub
  8. First say
  9. print vs. say
  10. Debugging
  11. Avoid global variables
  12. Keep it Simple - KISS
  13. Comments
  14. Perl documentation
  15. POD - Plain Old Documentation
  16. Exercise: Hello world
• Scalars
  1. Scalars intro
  2. Scalar values
  3. undef
  4. Numbers - integers, real or floating-point
  5. Strings
  6. Scalar variables (use my)
  7. Sigils and variables
  8. Common error messages
  9. Greeting with a name, Variable interpolation
  10. User Input
  11. chomp
  12. Numerical Operators
  13. Autoincrement
  14. String Operators
  15. String - Number conversion
  16. Conditional statements: if
  17. Syntax of if statement
  18. Comparison operators
  19. Compare values - examples
  20. undef, the initial value and defined
  21. Boolean expressions (logical operators)
  22. Boolean values: TRUE and FALSE
  23. Your Salary is in Danger - Short-Circuit
  24. Exercise: Rectangular
  25. Exercise: Rectangular prompt
  26. Exercise: Rectangular warn
  27. Exercise: Concatenation
  28. Exercises: Simple Calculator
  29. Solution: Rectangular
  30. Solution: Rectangular prompt
  31. Solution: Rectangular warn
  32. Solution: Concatenation
  33. Solution: Simple Calculator
  34. Solution: Simple Calculator (using eval)
  35. String functions (length, lc, uc, index)
  36. String functions (index, rindex)
  37. String functions (substr)
  38. Strings - Double quoted
  39. Strings - Single quoted
  40. Scope of variables
  41. Scope of variables - 2
  42. Scope of variables - 3
  43. Scope of variables - 4
  44. Scope of variables - 5
  45. Random numbers
  46. Here documents - double quotes
  47. Here documents - single quotes
  48. Exercise: Number Guessing game
  49. Solution: Number Guessing game
• Files
  1. die, warn, exit
  2. while loop
  3. Loop controls: next, last
  4. Opening file for reading
  5. Opening a file
  6. Opening a file - error handling
  7. Opening a missing file
  8. Read one line from a file
  9. Process an entire file line by line (while, cat)
  10. Write to a file
  11. Sum of numbers in a file
  12. Analyze the Apache log file
  13. Encoding and UTF-8
  14. Open files in the old way
  15. Binary mode
  16. Reading from file, read, eof
  17. tell, seek
  18. truncate
  19. Exercise: Add more statistics
  20. Exercise: Write report to file
  21. Exercise: Analyze Apache - number of successful hits
  22. Solution: Add more statistics
  23. Solution: Write report to file
  24. Solution: Analyze Apache - number of successful hits
• Lists and Arrays
  1. Lists and Arrays intro
  2. List Literals, list ranges
  3. List Assignment
  4. loop over elements of list with foreach
  5. Create an Array, loop over with foreach
  6. Array Assignment
  7. Debugging an array
  8. foreach loop on numbers
  9. Array index (menu)
  10. Load Module
  11. Command line parameters
  12. Process command line parameters, use modules
  13. Module documentation
  14. process CSV file
  15. process csv file (short version)
  16. One-liner sum numbers in CSV file
  17. process csv file using Text::CSV
  18. process csv file using Text::CSV
  19. Join
  20. Labels
  21. Exercise: Make the color selector user friendly
  22. Exercise: improve the color selector
  23. Exercise: Improve the Number Guessing game
  24. Solution: improved color selector
  25. Solution: Improve the Number Guessing game
• Advanced Arrays
  1. The year 19100
  2. SCALAR and LIST Context
  3. Context Sensitivity
  4. Filehandle in scalar and list context
  5. slurp mode
  6. File::Slurp
  7. Diamond operator
  8. pop, push
  9. push example
  10. stack (pop, push) Reverse Polish Calculator
  11. shift, unshift
  12. queue (shift, push)
  13. shift
  14. reverse
  15. Sort
  16. Ternary operator
  17. Count digits
  18. Exercise: Color selector
  19. Exercise: sort numbers
  20. Exercise: sort mixed string
  21. Exercise: sort mixed string 2
  22. Solution: color selector files
  23. Solution: sort numbers
  24. Solution: sort mixed strings
  25. Solution: sort mixed strings
  26. List::Util
  27. Advanced: Multi dimensional array
• Functions and Subroutines
  1. Why to use subroutines?
  2. Subroutines
  3. Variable number of parameters
  4. Recursive subroutines: factorial
  5. Recursive subroutines: Fibonacci
  6. Sort using a function
  7. Return a list
  8. Return several elements
  9. Error handling with eval - files
  10. Error handling with eval - two calls
  11. Exercise: Subroutines
  12. Exercise: Number guessing in sub
  13. Solution: Number guessing in sub
• Hashes
  1. What is a hash?
  2. Uses of hashes
  3. Creating hashes
  4. Create hash from an array
  5. Hash in scalar context
  6. Fetching data from hash
  7. exists, delete hash element
  8. Multi dimensional hashes
  9. Count words
  10. Exercise: Parse HTTP values
  11. Exercise: Improve the color selector
  12. Exercise: Display scores
  13. Exercise: Analyze Apache log file
  14. Exercise: Parse variable width fields
  15. Solution: Parse HTTP values
  16. Solution: Improve the color selector
  17. Solution: Display scores
  18. Solution: Analyze Apache log file
  19. Solution: Parse variable width fields
• Regular Expressions I
  1. What are regexes good for ?
  2. Examples
  3. Where can I use it ?
  4. Introduction to Regexes
  5. grep
  6. Tools
  7. Find a string in a file
  8. Regex Examples: single character
  9. Regex Examples: more characters
  10. Regex Examples dot .
  11. Regex Examples (character class)
  12. Regex Examples (^ in character class)
  13. Optional character
  14. Regex Examples quantifiers
  15. Quantifiers
  16. Quantifiers on character classes
  17. Exercises: Regular expressions
  18. Solutions: Regular expressions
• Regular Expressions II
  1. Grouping, alternatives
  2. Capturing
  3. Anchors
  4. Character classes
  5. Special character classes
  6. Exercise: Hex/Oct/Bin
  7. Exercise: Number
  8. Exercise: Roman numbers
  9. Solution: Number
  10. Solution: Hex/Oct/Bin
  11. Solution: Roman numbers
• Regular Expressions
  1. Regexp::Common
  2. Options and modifiers
  3. /i Case sensitivity
  4. Matching quotes
  5. /s single line
  6. /m multiple lines
  7. /x enable white spaces and comments
  8. Substitute
  9. Global substitute
  10. Greedy quantifiers
  11. minimal match
  12. Replace spaces
  13. Replace string in assembly code
  14. Full example of previous
  15. split with regular expression
  16. Fixing dates
  17. Exercise: split CGI
  18. Exercise: basename/dirname
  19. Exercise: Sort SNMP numbers
  20. Exercise: parse hours log file and give report
  21. Exercise: Parse ini file
  22. Exercise: parse perl file
  23. Solution: Split CGI
  24. Solution: filename/dirname
  25. Solution: Sort SNMP numbers
  26. Solution: parse hours log file and give report
  27. Solution: Parse ini file
  28. Solution: parse perl file
  29. Regular Expressions Cheat sheet
• Shell to Perl
  1. Shell and Perl intro
  2. File test or -X operators
  3. Running External Programs
  4. Open pipe for reading
  5. Open pipe for writing
  6. Pager
  7. sendmail.pl
  8. UNIX commands from the inside
  9. File globbing (wildcards)
  10. Rename files
  11. Directory handles
  12. File::HomeDir
  13. More UNIX commands implemented in modules
  14. File::Spec
  15. Change Copyright text in every source file in a directory hierarchy
  16. Exercise: Tree
  17. Exercise: Check for UID 0
  18. Exercise: CPU load
  19. Exercise: MANIFEST file
  20. Solutions: Tree
  21. Solutions: Check for UID 0
  22. Solution: CPU load
  23. Solution: MANIFEST file
• Using Perl modules, using CPAN
  1. Using modules exporting functions
  2. Using Object Oriented modules
  3. Selecting Module to use
  4. Some interesting CPAN Modules: DateTime
  5. Days passed
  6. Some interesting CPAN Modules: Databases
  7. Some interesting CPAN Modules: Web
  8. Some interesting CPAN Modules: common file format
  9. Some interesting CPAN Modules
  10. Installing modules
  11. Installing modules from the os vendor
  12. Using CPAN.pm
  13. Configure CPAN.pm
  14. Installing modules manually
  15. Installing modules manually using Build.PL
  16. On Windows
  17. Changing @INC
  18. Changing @INC - Relative PATH
  19. local::lib
  20. CPAN.pm
  21. Installing modules on ActivePerl
  22. CPAN::Reporter
  23. Exercise: setup local::lib
  24. Exercise: Module installation
  25. Exercise: Read Excel file
  26. Solution: Module installation
  27. Solution: Read Excel file
• Applications
  1. Simple uses of Perl
  2. Create Unix user account
  3. Reporting file system diskspace usage (df)
  4. Reporting diskspace usage on the mail server
  5. A du like script
  6. Send files by e-mail
  7. Read Excel file
  8. Process file with fixed width records
  9. Process file with multiline records
  10. Process multi field csv file
  11. Fetch web page
  12. Generate web page
  13. Parse XML file
  14. Database access using DBI and DBD::SQLite
  15. Net::LDAP
  16. Tie::File
• One-liners
  1. One-liner: print
  2. One-liner: Rename many files
  3. One-liner: grep on Windows as well
  4. One-liner: Replace a string in many files
  5. One-liner: Change encoding
  6. One-liner: print the 3rd field of every line in a CSV file
  7. One-liner: Print all usernames from /etc/passwd
• Extra slides
  1. List all defined variables
  2. Perl internal variables
  3. What is Perl ?
  4. What does Perl stand for ?
  5. Scripting language ?
  6. Is Perl Interpreted or Compiled Language
  7. Why use Perl ?
  8. What is it good for ?
  9. Its strengths
  10. Redirection by the user
  11. for loop
  12. ASCII table
  13. default variable $_
  14. Return values
  15. UNIX file system, hard links symbolic links
  16. stat, lstat
  17. Compare values
  18. Bitwise Operations
  19. bitwise examples
  20. Filename creation based on date
  21. Debugging prints
  22. Where is perl installed on your system ?
  23. Send e-mail
• XML using Perl
  1. XML sample data
  2. XML Definitions
  3. XML processing modes
  4. XML::Simple
  5. XML::Simple dumped
  6. XML::Simple processing
  7. XML::Parser
  8. XML::Parser tree
  9. XML::Parser tree results
  10. XML::Parser
  11. XML::LibXML
  12. XML::XPath
  13. XML::Twig
  14. XML::Writer
  15. XML::Dumper
  16. Exercise: parse glade.xml
  17. DTD validation
  18. Specialized XML modules
  19. Resources
• Parsing HTML File
  1. HTML::Parser - fetch title
  2. HTML::Parser
  3. HTML::Encode
  4. Autoclose
• Appendix
  1. Resources, How to get support for Perl ?
  2. Recommended Books
• Perl References
  1. Uses cases for references
  2. References
  3. Array References
  4. Hash References
  5. Scalar references
  6. Subroutine references
  7. Passing values to a function
  8. Add two (or more) arrays
  9. Add two arrays
  10. Array References
  11. Process arrays without copying
  12. Scope of variables
  13. Reference counting
  14. More Reference Counting
  15. Process arrays without copying even the return values
  16. Debugging (pretty printing)
  17. Change values in a reference
  18. Exercise: double numbers
  19. Exercise: Add many arrays
  20. Exercise: Function to compare two hashes
  21. Solution: Double numbers
  22. Solution: Add many arrays
  23. Solution: Add many arrays
  24. Solution: Function to compare two hashes
  25. Anonymous Arrays
  26. Array of Arrays
  27. Array of Arrays (AoA)
  28. Many dimensional arrays
  29. Anonymous hashes
  30. Hash of Hashes (HoH)
  31. More complex data structures
  32. Memory leak with cross references
  33. Memory leak with cross references - weaken
  34. Read CSV file
  35. Exercise: read in an ini file
  36. Exercise: improve the csv reader
  37. Solution: Read ini file
  38. Solution: improve the csv reader
  39. autovivification
  40. Scalar references in Getopt::Long
  41. Anonymous subroutines
  42. Uses of Subroutine references
  43. Exercise: DNA Sequence Analyzer
  44. Solution: DNA Sequence Analyzer
  45. Exercise: DNA Sequence Analyzer with callback
  46. Solution: DNA Sequence Analyzer with callback
  47. Exercise: DNA Sequence Analyzer with shortcut
  48. Solution: DNA Sequence Analyzer with shortcut
  49. Dispatch Table
  50. Dispatch Table using symbolic references
  51. The ref() function
  52. Copy a data structure
  53. Deep copy
  54. Deep copy - Storable dclone
  55. Serialization
  56. Data::Dumper
  57. Data::Dumper both dump and restore
  58. Storable
  59. Storable in memory freezing
  60. YAML
  61. YAML in one file
  62. JSON in one file
  63. Main uses of references
  64. Exercise: save ini and csv as YAML
  65. Exercise: Create a cache for NetSlow
  66. Exercise: create a function that generates numbers multipliers
  67. Solution: save ini and csv as YAML
  68. Solution: Create a cache for NetSlow
  69. Solution: NetSlow cache with timeout
  70. Resources
• Processes and signals
  1. Signals and the kill function
  2. Catch signals
  3. Catch Ctrl-C
  4. Exercise: Catch ctrl-c and ask continue or terminate?
  5. Solution: Catch ctrl-c and ask
  6. Graceful termination of process
• Advanced slides
  1. Always use strict and warnings
  2. Avoid warnings
  3. Turn off warnings selectively and in a small scope
  4. Catch and log warnings
  5. splain and use diagnostics
  6. Fatal warnings
  7. Logging Exceptions
  8. Always open files in the new way
  9. Array slices
  10. Array slices on the fly
  11. Hash slices
  12. Hash slices in assignment
  13. splice
  14. LIST and SCALAR context
  15. wantarray
  16. wantarray example
  17. Slow sorting
  18. Speed up sorting
  19. Schwartzian transformation
  20. Compilation phases: BEGIN, CHECK, INIT, END
  21. AUTOLOAD
  22. Static variable
  23. Exercise: create counter
  24. Solution: create counter
  25. Saved variable: local
  26. autodie
  27. Modern::Perl
  28. Perl::Critic
  29. Perl::Tidy
  30. caller
  31. Log::Dispatch
  32. Log::Log4perl easy
  33. Exercise: Log::Dispatch
  34. Solution Log::Dispatch
• Functional Programming in Perl
  1. Programming Paradigms
  2. Functional programming
  3. grep
  4. grep to filter files based on modification date
  5. Imitating the Unix/Linux grep command in Perl
  6. map
  7. Use map to filter values
  8. Map to add more elements
  9. Use map to filter and enrich
  10. Create a hash from an array using map
  11. Unique values
  12. Unique values - improved
  13. Unique values using grep
  14. Uniq with List::MoreUtils
  15. Closures
• Advanced Features in 5.10
  1. Advanced Features
  2. defined or
  3. Turn on features explicitly
  4. say
  5. feature is a lexical pragma
  6. static variable (with scope)
  7. state variable
  8. regex: Named capture buffers
  9. Possessive quantifier
  10. smartmatch ~~ - Don't use it!
  11. Smart match example - Don't use it!
  12. switch - Don't use it!
• New features in 5.12
  1. Perl 5.12 features
  2. Implicit stricture
  3. use parent
  4. package NAME VERSION
  5. Yada Yada Operator...
  6. each on arrays
  7. delete local
• Perl Libraries and Modules
  1. Lack of code reuse
  2. Perl library (perl4 style)
  3. Problems with Libraries
  4. Prefix everything with unique name
  5. Namespaces
  6. Solution with namespace
  7. Modules
  8. Packages, @INC and Namespace hierarchy
  9. use, require and import
  10. Export - Import
  11. Restrict the import
  12. On demand Import
  13. Importing
  14. Modules - behind the scene
  15. Tools for packaging and distribution
  16. Packaging modules
  17. Makefile.PL of ExtUtils::MakeMaker
  18. Makefile.PL of Module::Install
  19. Build.PL of Module::Build
  20. Changes and README
  21. MANIFEST and MANIFEST.SKIP
  22. A script
  23. A module
  24. Packaging with Makefile.PL
  25. Packaging with Build.PL
  26. A test file
  27. Writing Tests
  28. Exercises: Multiply numbers
  29. Solution: Multiply numbers
  30. Overview
• Error Handling
  1. Returning error status or throwing exception?
  2. eval block
  3. Exception handling with Try::Tiny
  4. Carp
  5. Carp::Clan
  6. The problem with die and croak
  7. Exception::Class
  8. Processing exceptions
  9. Exercise
  10. Solution
  11. Solution
• Introduction to Moose
  1. Moose Constructor
  2. Test Moose Constructor
  3. Moose Attribute
  4. Test Moose Attribute
  5. Moose Attribute Type
  6. Test Moose Attribute Type
  7. Moose Attribute Type class
  8. Test Moose Attribute Type class
  9. Moose Attribute - create your own subtype
  10. Test Moose Attribute - create your own subtype
  11. Moose Attribute - coercion
  12. Test Moose Attribute - coercion
  13. Moose Enumeration
  14. Moose Attributes Overview
  15. Inheritance
  16. Testing Inheritance
  17. MooseX::StrictConstructor
  18. Testing Strict attributes
  19. Encapsulation
  20. Class data
  21. Special actions during object construction
  22. Singleton in Moose
  23. Destructor in Moose
• More about files
  1. Exercise: Create a counter
  2. Exercise: Create multiple counters
  3. Exercises: List old logfiles
  4. Solution: Create a counter
  5. Solution: Create multiple counters
  6. Solutions: List old logfiles
• Running subprocess
  1. Possibilities
• Perl Tk
  1. Perl Tk
  2. Perl Tk Plain Window
  3. Perl Tk Label
  4. Perl Tk Button
  5. Perl Tk Entry (visible and hidden for secrets)
  6. Perl Tk Text editor
  7. Perl Tk Menu
  8. Perl Tk Keyboard binding
  9. Perl Tk Any Key binding
  10. Perl Tk Mouse button and movement bindings
  11. Perl Tk Mouse events, coordinates
  12. Perl Tk Checkbutton (Checkbox)
  13. Perl Tk Radiobutton
  14. Perl Tk Listbox
  15. Perl Tk Dialog
  16. Perl Tk DialogBox with custom buttons and widgets
  17. Perl Tk Notepad (Simple editor)
  18. Perl Tk Message
  19. Perl Tk with HTML
  20. Perl Tk Dialog Box with HTML
  21. Perl Tk Browse Entry (ComboBox)
  22. Perl Tk Option Menu
  23. Perl Tk Table
  24. Perl Tk Menu Button
• Prima
  1. Prima Hello World
• wxPerl - wxWidgets for Perl
  1. wxPerl - Hello World
• Microsoft Windows
  1. Win32 examples
• PSGI
  1. PSGI Cookbook
• Testing Demo for Perl
  1. Testing Demo AUT
  2. Testing Demo using Test::More (success)
  3. Testing Demo using Test::More (failure)
  4. Testing Demo - Test coverage report
• Parallel processing
  1. Types of problems
  2. Types of solutions
  3. Tasks
  4. Measurements on 32 core
  5. Measurements on 4 core
  6. The Hardware
  7. Installations
  8. Fork
  9. Fork with functions details
  10. Fork random and seed
  11. Fork without functions
  12. Fork details
  13. Fork many
  14. Parent process ID
  15. pstree
  16. htop
  17. Active non-blocking waiting with waitpid
  18. Non-blocking waiting with waitpid - multiple forks
  19. Non-blocking waiting, rerun on failure
  20. Functions to be speed up
  21. Counter process
  22. Forked counter process
  23. Prepare CSV files
  24. Process CSV files
  25. Use Parallel::ForkManager
  26. Return values using Parallel::ForkManager
  27. Forked process CSV files
  28. HTTP GET
  29. Forked HTTP requests
  30. Exercise: Process Excel files
  31. Exercise: Web crawler
  32. MCE - Many-Core Engine
  33. MCE - map running in parallel
  34. MCE - map with init
  35. other modules
• Database Testing
  1. Database testing
  2. A couple of tools
  3. Test::More and DBI
  4. Test::DatabaseRow
  5. Test::DatabaseRow fail
  6. Test::DatabaseRow tests more than one row
  7. Test::DatabaseRow tests more than one row - failure
  8. Test::DatabaseRow without SQL
• Database access using Perl DBI
  1. Architecture of a DBI Application
  2. Create Sample Database
  3. Connect to database
  4. SELECT with one result
  5. SELECT with more results
  6. SELECT, prepare with placeholders
  7. SELECT, using hashref
  8. INSERT
  9. UPDATE
• Advanced Database access using Perl DBI
  1. Data integrity
  2. Transactions
  3. Sample database creation
  4. Disconnect from the database
  5. Attributes
  6. Error handling
  7. Debugging (Trace levels)
• Database access using DBIx::Class
  1. DBIx::Class
  2. Create Sample Database
• Microsoft Windows GUI Testing
  1. GUI testing
  2. Keyboard and mouse movements
  3. Win32::GuiTest
  4. Win32::GUIRobot
  5. Calculator
  6. Launch the application
  7. Locale
  8. Close the application
  9. Using the Keyboard
  10. Check the children
  11. Fetch content of a control
  12. Window location
  13. Move the mouse
  14. Move the cursor around the edges
  15. Close the window by a mouse click
  16. Calculate using the mouse
  17. The full calc.pl example
  18. Installing Win32::GuiTest
  19. Tools
• Internet Explorer
  1. Win32::IE::Mechanize
  2. Accessing Google
  3. Examples
• X-Windows
  1. X11
  2. X11 Tools
  3. X11::GUITest
  4. LDTP - Linux Desktop Testing Project
  5. Manual steps
  6. X11: Launch the application
  7. Let's see the coordinates
  8. Where is this top left corner ?
  9. And let's see the rest of the coordinates
  10. Smooth on the edges
  11. Closing the window
  12. Placing the cursor on one of the buttons and clicking on it
  13. So let's do all the calculations
  14. Fetch the list of Child Windows
  15. Locate the Child Windows
  16. Using the keyboard
  17. Separate the keystrokes
  18. Full solution for xcalc
• Appendixes
  1. Test related CPAN Modules
  2. Generic modules
  3. Web testing
  4. GUI testing
  5. Other sources of information
  6. Test Realistically
  7. Test Unrealistically
  8. File System testing
• Other
  1. Read CSV file as array of hashes
  2. Sort array using sort and sort_by
  3. Range iterator
  4. Benchmark
  5. Bubble sort
  6. Insert sort
  7. Merge sort
  8. Quicksort
  9. Timsort
  10. Traverse directory tree
  11. Traverse directory tree with call back
  12. Linear search in unorderd array
  13. Binary search in sorted array
  14. Convert curl command with -F to LWP::UserAgent
  15. Modify time anomality in two files