Onur Varol's Home Page

An introduction to the fields of machine learning and data mining from a statistical perspective. Machine learning is the study of computer algorithms that improve automatically through experience. Vast amounts of data generated in many fields from biology to finance to linguistics makes a good understanding of the tools and techniques of machine learning indispensable. Topics covered include regression, classification, kernel methods, model assessment and selection, boosting, neural networks, support vector machines, nearest neighbors, and unsupervised learning.

Applications of artificial intelligence in user interfaces. Design, implementation, and evaluation of user interfaces that use machine learning, computer vision and pattern recognition technologies. Supporting tools for classification, regression, multi-modal information fusion. Gaze-tracking, gesture recognition, object detection, tracking, haptic devices, speech-based and pen-based interfaces.

Study of computational models of visual perception and their implementation in computer systems. Topics include: image formation; edge, corner and boundary extraction, segmentation, matching, pattern recognition and classification techniques; 3-D Vision: projection geometry, camera calibration, shape from stereo/silhouette/shading, model-based 3D object recognition; color texture, radiometry and BDRF; motion analysis.

Theory and practice of 3D computer graphics. Topics covered include graphics systems and models; geometric representations and transformations; graphics programming; input and interaction; viewing and projections; compositing and blending; illumination and color models; shading; texture mapping; animation; rendering and implementation; hierarchical and object-oriented modeling; scene graphs; 3D reconstruction and modeling.

Network flow models and optimization problems. Algorithms and applications. Minimum spanning tree problem. Shortest path problems. Maximum flow problems, minimum cuts in undirected graphs and cut-trees. The minimum cost network flow problem. Matching problems. Generalized flows. Multicommodity flows and solution by Lagrangean relaxation, column generation and Dantzig-Wolfe decomposition. Network design problems including the Steiner tree problem and the multicommodity capacitated network design problem; their formulations, branch-and-cut approaches and approximation algorithms.

Basic and advanced topics in information retrieval. Processing, indexing, querying and retrieval of textual documents. Modern search engines and their principles. Implementation of search engine systems for real-world applications.

Linear Algebra Review, Normal Matrices, Quadratic Forms and Semidefinite Matrices, Inner Product and Norm Spaces, State Space Descriptions for Continuous and Discrete Time Systems, Controllability, Observability, Stability, Realization Theory.

The individual as a member of social groups and social psychological perspectives on issues such as aggression and violence, bystander intervention, obedience, conformity, attitudes, prejudice, and attribution.

Relevance of Electronics Engineering curriculum to the practice of engineering in manufacturing and R & D environments. Various approaches and methods in problem solving, introduction to electronics and systems; examples of applications.

Physical electrical circuits. Modelling and measurements of currents and voltages in physical circuits. Definitions of charge, flux, power and energy and modelling their waveforms. Kirchhoff's Laws:current and voltage equations. Circuit graphs. Graph matrices. Ideal 2-terminal and multi-terminal circuit elements. Modelling of physical elements. Small-signal analysis of nonlinear circuits. Analysis of linear and nonlinear resistive circuits:Node-voltage and mesh current methods. Circuit Theorems: Tellegen's theorem, Superposition theorem . Reciprocity theorem. Thevenin and Norton theorems. Solution of dynamic circuits: responses of first- and second-order dynamic circuits.

Physical electrical circuits. Modelling and measurements of currents and voltages in physical circuits. Definitions of charge, flux, power and energy and modelling their waveforms. Kirchhoff's Laws:current and voltage equations. Circuit graphs. Graph matrices. Ideal 2-terminal and multi-terminal circuit elements. Modelling of physical elements. Small-signal analysis of nonlinear circuits. Analysis of linear and nonlinear resistive circuits:Node-voltage and mesh current methods. Circuit Theorems: Tellegen's theorem, Superposition theorem . Reciprocity theorem. Thevenin and Norton theorems. Solution of dynamic circuits: responses of first- and second-order dynamic circuits.

Introduction; Components and basic circuits: Operational amplifiers, concepts and application examples. Diodes: ideal diode, terminal characteristics of the junction diode, analysis of diode circuits, semiconductor principles, structure of the junction diode. Bipolar junction transistor (BJT): physical structure and operating modes, DC biasing, BJT as an amplifier, small-signal model, basic amplifier circuits, BJT as a switch. MOSFET: structure and operating modes, MOSFET amplifiers. MESFET.

1.Supply voltage circuits 2.DC characteristics of BJTs and MOSFET's 3.Amplifiers 4.Linear applications of operational amplifiers 5.Lojic gates and flip-flops 6.Non-linear applications of operational amplifiers

Multistage amplifers. Operational amplifier circuits and applications. Circuits derived from op amps. Analog multipliers. Frequency response of amplifiers. Feedback, stability problems in feedback circuits, compensation. Sinusoidal oscillators. Power amplifiers.

State equations of higher order circuits and their solutions in t and s domain. State transition matrix and its properties. Zero state, zero input responses. Stability, Routh criteria. Controllability and observability. Analysis of dynamical systems in jw-domain. Sinusoidal steady state. Phasors, phasor network equations. Power and energy. Three phase systems. Network and system equations in s domain. Bode diagrams. Block diagram and signal flow graphs

Experiment 1: Low-freguency power amplifiers Experiment 2: Analog integrated circuits building blocks Experiment 3: Frequency and pulse response of BJT amplifers Experiment 4: Feedback and stability in transistorized amplifiers Experiment 5: Broad-band amplifiers Experiment 6: Low-frequency oscillators Experiment 7: Active filters Experiment 8: PLL applications

Network synthesis problem. Filter approximation: Butterworth and Chebsyhev approximations, impedance and frequency normalization, Passive network synthesis: Positive real functions. Synthesis of LC, RC, RL, RLC networks: Cauer's and Foster's realizations. Synthesis of passive 2-ports, Positive real matrices, Synthesis of 2-ports converted to synthesis of 2-terminals. Ladder network synthesis: zero shifting technique. Active network synthesis: decomposition, coefficient matching and signal flow graph methods. Examples of active network synthesis using modern active devices (current conveyor, OTA, opamp)

General principles, input-output variables, motor, generator and transformer. Energy conservation and energy balance equation. Relationships between torque-force and magnetic-electric field energies. Self and mutual inductances, torque and force. Generalized and simple machine models, mathematical and circuit models. Conditions for continuous energy conversion, various machine models.

Discrete-time modelling and block-diagram representation of continouos-time systems. Realization of transfer functions in state space. Feedback concept. PID contoller and its influence on system response. Time-domain criterion and stability analysis. Frequency domain criterion and stability analysis. Linearization methods for nonlinear control systems. Root-locus diagrams.

Initial course in Boole algebra, combinational logic design, synchronous sequential circuit analysis and synthesis.

Ideal inverter, various types of (NMOS, resistive-load, etc.) inverters, CMOS inverter, NAND, NOR gates, complex gates, transmission gates, various flip-flop circuits, read-only memories (ROM), static ve dynamic random-access memories (SRAM and DRAM)

Design of high order active filters. Modelling and simulation of human cardiovascular system. The general principles in the design of microprocessor supported biomedical systems. The design of bioelectric signal processing systems: human reaction time measurement device, electrocardiography, arrhythmia detector, right leg driver, blood flow and heath rate measuring devices. Data compression techniques. Biotelemetry. Recording of biological signals to the magnetic recorders.

Introduction to human physiology: The cell and its function, origin of the action potential; bioreceptors; nervous, muscular, cardiovascular, respirator, gastrointestianal, urinary and endocrin systems; the special sense organs; biological signals originated from human systems. Sensing and preprocessing of biological signals: Characteristics of biological signals, the basic amplifiers and basic circuits used for analog processing of biological signals, instrumentation amplifier; electrodes, features and applications; resistive, capacitive, indusctive, piezolectric , electromagnetic and termic transducers; transducer amplifiers and their calibration.

Basic concepts in medical electronics. Patient isolation and protection of equipments in medical electronics. Biological signal (electrocardiogram, electromyogram, phonocardiogram, electroencephalogram, blood pressure, etc.) measurement equipments. Cardiotachometer. Photoelectric measurement equipments in medical electronics: Photoplestismograph. Simulation of human cardiovascular system in computer environment. Transfer of biological signals to the computer. Digital filtering and monitoring of biological signals in real-time. Computer aided analysis of biological signals. Transmission and storage of biological signals. Remote measurement in medical electronics: Telemedicine. Advanced topics and applications in medical electronics.

Amplitude modulation techniques. Amplitude modulators and demodulators. Frequency and phase modulation. Frequency modulators and demodulators. Frequecy division multiplexing. Pulse modulation techniques. Quantization, compressing-expanding, analog-digital converters, delta modulation. Baseband data transmission. ıntersmbol interference, Nyquist channel, multilevel baseband transmission, error performance analysis. Digital modulation technques. Amplitude-shift, phase-shift and frequency-shift keying.

Classification of signals and systems. Fourier analysis of continuous and discrete signals and systems. Modulation concept and sampling theorem. Sampling in time and frequency domain. Discrete and fast Fourier transform. Tranformation of continuous time systems into discrete time systems. Representation of difference eqations. State space equations and their solution. z transformation and their properties. Analysis of discrete time systems in z domain. ıntroduction to filtering.

vectors and electromagnetics, elektrostatics, magnetostatic fields components, EM fields in different materials. Elementary electromagnetic field theory as summarized in Maxwell's equations for time varying fields in integral and differential form, energy storage and quasistatic fields, EM field and materials, vector calculus and potential functions, time domain analysis of waves, PC assisted instruction of field calculations.

Current and voltage waves in transmission lines, frequency and time domain analysis, power and energy flow, impedance matching, Smith Chart, microstrip lines, pulse transmission on lines, basic principles of circuit analysis by S-parameters, basics of microwave radio propagation and introduction to antennas.

Introduction, image formation; image model, imaging devices, low level vision: smoothing, edge detection, edge linking, multiscale approaches, Intermediate level vision: surface reconstruction, shape from shading, motion and stereo, range imaging, high level vision; model-based vision, semantic nets, generalized cylinders, Hough transform, Stereo Vision, Camera Calibration, Shape from shading, Shape from Motion, Ransac, Planar Homographies, mosaicing stabilization, Video Tracking, Object Recognition

Fundamental concepts of real-time signal processing.Architecture of real-time signal processors.Hardware interface implemented by peripheral units.DSP programming techniques.Software development tools.Anolog/digital and digital/anolog converter, sampling. Real-time signal processing techniques.Real-time signal processing techniques.Real time implementation of signal processing algorithms, and frequecy domain processing. Data compressing. Learning process and classifiers in real-time.

As a motivation, biological neural systems. Definition of Artificial Neural Networks (ANN). Supervised and unsupervised learning. Adaptive linear element. Mean square learning rule. Design of linear associative memory. Multi-layered perceptron design. Back propagation algorithm. Radial based ANN. Dynamic ANN. Hopfield net, cellular ANN. Kohonen Selforganized map. Pattern, image, speech processing and control with hardware and software realization of ANN.

Origins and properties of biological signals. Transducers for biological signals. Patient isolation methods. Fundamentals of computer units. Computer assisted biological signal acquisition, processing and monitoring. Archiving and transmitting of biological signals and images in and between medical centers. Computer aided telemetric system design. Microprocessor based blood pressure, body temperature, electrocardiogram, and electromyogram measurement devices.

Functions of one variable; limits and continuity, derivative and differantiation; chain rule, implicit differentiation. Applications of derivative; maxima and minima, the mean value theorem. Integration; indefinite integrals, integral rules, definite integrals, the fundamental and the mean value theorems of integral calculus. Applications of definite integrals; length of curves, area, volumes of revolution. Transcendental functions. Integration techniques, L'Hospital rule, Improper integrals.

Sequences; limits, monotone sequences. Series with positive terms, series with arbitrary terms, absolute and conditional convergence, power series, Taylor and Maclaurin series. Vector calculus. Functions of multiple variables; limits, continuity, partial derivatives, chain rule, directional derivatives, maxima and minima, Lagrange multipliers, Taylor's formula. Double and triple integrals, line integrals, Green's theorem in the plane, Surface area and surface integrals, Divergence and Stokes theorem.

First order equations; separable equations, linear equations, change of variable and integrating factor, existence and uniqueness theorems, applications. Higher order linear equations; the method of variation of parameters, reduction of order, Constant coefficient equations, the method of undetermined coefficients. Euler-Cauchy equation. Power series method; solution around ordinary and regular-singular points. Laplace transformation; basic definition and theorems, solution of initial value problems, convolution, delta function, transfer function. Systems of linear differential equations; fundamental theory and solutions, solutions using Laplace transformation. Second order linear partial differential equations and separation of variables.

Combinatorial methods; product rule, permutation, combination. Probability; sigma algebra, probability axioms, conditional probability, Bayes formula. Random variable; distribution function, probability function, Chebyshev inequality. Discrete and continuous distributions; uniform, Bernoulli, Poisson, geometric, hypergeometric, normal, exponential, gamma and beta distributions. Generating functions. Decision theory. The notion of estimation. Hypothesis testing. Non-parametric testing. Correlation and regression.

Systems of linear equations and matrices; matrices and matrix algebra. Vector spaces, bases and dimension, coordinates, base change. Inner product spaces; Hermitian product, Gram-Schmitdt method, orthonormal bases. Linear transformations. Space of linear transformations, isomorphisms, matrix representations of linear transformations. Determinants; properties of determinants, inverse of matrices, applications of determinant, Cramer�s rule. Eigenvalues and eigenvectors; characteristic polynomical, Cayley Hamilton Theorem. Diagonalizaiton, quadratic forms, application to systems of differential equations.

Accuracy estimation in numerical methods, error propagation. Root finding for system of nonlinear equations; Newton's and Newton-Raphson's methods. Solution methods for system of linear equations. Interpolation, extrapolation and curve fitting. Numerical differentiation integration. Numerical solutions of ordinary differential equations. Finite Differences; forward, backward and central differences, Runge-Kutta Methods.

The scope of chemistry and stoichiometry, atoms and the atomic theories, the periodic table and some atomic properties, chemical bonding, molecular geometry, gases and gas laws, liquids, solids, solution and their physical properties, thermochemistry, chemical kinetics, principles of chemical equilibrium, acids and bases, solubility.

1. The identification reactions of anions. 2. The identification reactions of cations. 3. Determination of reaction rate. 4. Preparation of an inorganic preparat. 5. Determination of the hydrate formula. 6. Iodometry. 7. Determination of dissociation constants of weak acids. 8. Determination and removal of hardness of water. 9. Determination of pH with colorimetric method. 10. Synthesis of soap

Mechanical behavior of materials: tensile test, stress-strain relations, brittle behavior, ductile behavior, shear effect, hardness. Physical properties of materials: specific gravity, water absorption, void ratio, permeability, capillary water absorption. Internal structure of materials: atomic scructure, ionic bonding, covalent bonding, metallic bonding. Van der Waals bond, classification of materials. Crystalline structure: directions and planes, metals and ceramics. Crystal defects: point defects, planar defects. Non-crystalline materials: Glass, fluid, gas, phases. Solid solutions. Atomic diffusion. Strengthening mechanisms in metals, cold hardening, hot hardening, alloying, annealing, eutectic alloys, heat treatment, tempering. Creep, relaxation, fracture, and fatigue constitutive equations of materials.

Vectors. Motion in one dimension. Motion in two dimensions. Newton's laws and their applications. Newton's universal gravitation law. Work and energy. Conservation of energy. Momentum and motion of systems. Static equilibrium of rigid bodies. Rotation and angular momentum.

Fundamental measurements. Motion with constant acceleration. Conservation of linear momentum. Equilibrium. Friction. Rotation dynamics. Simple harmonic motion. projectile motion. Elastic and inelastic collisions in two dimensions. Moment of inertia. Centripetal accelaration. physical pendulum.

Periodic motions. Free oscillations. Forsed oscillations and resonance. Standing and propagating waves. Fluid mechanics. Sound. Temperature and heat conduction. I. Law of thermodynamics. Kinetic theory of gases. II. Law of thermodynamics.

Latent heat of ice melting. Specific heat of solids. Heat capacity. Thermal expansion coefficient of solids. Ideal gas law. Heat conductivity. Joule-calory conversion coefficient. Binomial distribution. Probability and entropy.

Sinusoidal oscillations, definition of simple harmonic motion with complex exponential function, superposition of periodic oscillations, Lissajou curves, free oscillations of physical systems, forced oscillations and resonance, resonance examples, coupled oscillators and normal modes, continuous systems and Fourier analysis, waves, Huygens-Fresnel principle, reflection-refraction-interference.

Resonance of free oscillations of physical systems and applications; compound pendulum, torsion pendulum, connected in series RLC circuit, the parallel RLC circuit, Lissajou curves, the wire waves, damped harmonic motion, Fourier analysis, polarized microwave, refractive index, single-slit diffraction and networks.

Relativity. Particle characteristics of waves. Wave characteristics of particles. Atomic structure. Quantum mechanics. Quantum theory of the hydrogen atom. Many-electron atoms. Molecules. Statistical mechanics. Solid state physics.

FranckHertz experiment Atomic spectrum Bragg scattering Unceartinity principle StefanBoltzman law at high and low temperatures Determination of e/m Absorption spectroscopy Thermoionic emission photo-electric effect total reflection of electromagnetic waves.

Mathematic of Quantum Mechanic, Lineer Vector Spaces, Operators, Matrix Algebra and Eigen Value problem, Fundamental experiments in Quantum Physics, Wave Packets, Uncertinity princible, Schrödinger equations, angular momentum and quantizations

3 dimensional Schrödinger equation: systems with spherical symmetry. Radial equation. Free particle. Infinite spherical well. Two-particle problem. Hydrogen atom. Stern-Gerlach experiment, spin angular momentum. Differential and matrix representations of operators. Spin- magnetic field interaction. Addition of angular momenta: Clebsch-Gordan coefficients. Identical particles. Particle interchange operator. Pauli principle. N-particle systems. Spin and statistics. Time-independent perturbation theory: first and second order perturbations. Degenerate perturbation theory. Stark effect. Fine structure and hyperfine structure of the hydrogen atom. Zeeman effect. EPR paradox and the principle of locality. Seperability problem and quantum entanglement.

Macroscobic systems, probabilty, statistical physics, essential background in thermodinamics, kinematics of gases, second law of thermodinamic, statistical machanics of ideal gass

Latent heat of melting ice. Specific heat of solids. Coefficient of thermal expansion of solids. The ideal gas law. Thermal conductivity. Joule-Thomson effect. Binomial distribution. Maxwell distribution. The equation of state of gases

Statistical ensembles. Canonical and grand canonicals ensemble. Free energy chemical potential and fugacity. Ising model and lattice gases. Transfer matrix in one dimension. Applications to polymers. Mean field theory. Bethe-Peirls approach. Statistical models on Bethe lattice. Landau theory of phase transitions. Ornstein-Zernike approximation. Partition functions Thermodynamical limit. Classification of phase transitions. Lower critical dimension Critical phenomena and critical exponentials and scaling theory. Simple renormalisation group transformationss. Quantum systemsFermi and Bose statics. Bose condensation. Evolution of probability distributions to reach the equilibrium state. Monte Carlo methods( student are expected to implement these methods in a computing language of their choice)

Second order differential equations: introduction. Solution of homogeneous equations. Singularities and series solutions. Frobenius method. Special functions: cylindrical and spherical coordinates. Boundary value problems. Sturm-Liouville problem. Legendre polynomials. Bessel functions. associated Legendre functions. spherical harmonics. Neumann functions. Modified Bessel functions. Fourier-Legendre series. Asymptotic behaviors of certain special functions. Complex functions: complex numbers. Basic operations with complex functions, analytic functions. Cauchy theorem. Singularities. Taylor and Laurent series. Residue theorem and applications. Complex functions.

Special functions, hypergeometric and confluent hyper geometric functions; partial differential equations, general knowledge, method of characteristics, separation of variables method, Laplace, Helmholtz, wave and diffusion equations; Green s function method for SturmLiouville type problems, solving inhomogeneous Laplace, Helmholtz, wave and diffusion equations using the Greens Function method; İntegral transforms, Fourier transform and momentum representation, convolution theorem, Laplace transform; calculus of variations, Euler Lagrange equation, Lagrance multipliers, variation subject to constraints

Motion of a particle in one,two and three dimensions;Motion of a system of particles;Variation principles and Lagranges Equations;Twobody central force(Kepler) problem;Small oscillations;Hamilton equations of motion; Conservation Laws and Canonical transformations; Hamilton Jacobi Theorem

Representations of numbers in computers. Error calculation. Root calculation. Approximation calculation. Approximations for functions. Numerical integration and differentiation. Solution of systems of coupled linear equations.

Least square data fitting. Eigenvalues and eigenvectors. Numerical solution of nonlinear systems of equations. Numerical solution of ordinary differantial equations. Boundary value problem for ordinary differantial equations

Crystal structures and interatomic forces, Diffraction in crystals, Lattice vibrations: Thermal, Acoustic,. and Optical properties, Metals: The Free electron model, Energy bands in solids, Semiconductors

Vector analysis , Differential and Integral Calculus, Curvilinear Coordinates ,Dirac Delta Function, Vector Fields, Electrostatic Fields, Electric Potential, Work and Energy, Conductors, Laplaces Equation, Electric Multi-pole, Polarization, Electric Displacement, Dielectrics, Lorentz Force ,Biot -Savart Law, Divergence and Curl of Magnetic Field, Vector Potential, Magnetization, Linear and Non Linear, Electromagnetic Media Induction, Maxwells Equation, Conservation Laws.