Pattern Theory Lunch Seminar Series

Brown University


Contact Matt Harrison for questions, speaker recommendations, to meet with a speaker, or to volunteer.

To receive email reminders about talks, click here.

Upcoming Talks

May 6, 2015

12-1pm, 182 George St Room 110

Two Recent Information Theoretic Variations on the Theme of Patterns in Security

Muriel Medard

Cecil H. Green Professor
Electrical Engineering and Computer Science Department
Massachusetts Institute of Technology

We overview two different sets of results based upon the effect of patterns in security. In the first part, we consider limits of inference, a problem that emerges when we seek to ascertain what limits to privacy we can expect when machine learning algorithms, whose theoretical basis often relies on principal inertia components, are applied to mining publicly available data that may be related, in loosely known ways, to private data. Lower bounds for the average probability of error of estimating a hidden variable X given an observation of a correlated random variable Y, and Fano's inequality in particular, play a central role in information theory. We present a lower bound for the average estimation error based on the marginal distribution of X and the principal inertias of the joint distribution matrix of X and Y, providing thus limits to privacy. Furthermore, we investigate how to answer a fundamental question in inference and privacy: given an observation Y, can we estimate a function f(X) of the hidden random variable X with an average error below a certain threshold? We provide a general method for answering this question using an approach based on rate-distortion theory.

In the second part, we consider recent results on guesswork, the characterization of the process sequences such as passwords. We note that, what may appear as being even slight differences in distributions of these sequences may lead to differences that are exponential in guesswork, leading to possibly surprising results, such as the failure of the oft-assumed uniformity of compressed sources, and the fact that friendly jamming of an intended user may be advantageous. We conclude with our recently defined notion of inscrutability rate, used to quantify the asymptotic difficulty of guessing U out of V secret strings, Unexpectedly, the inscrutability rate of any finite-order Markov string-source with hidden statistics remains the same as the unhidden case, i.e., the asymptotic value of hiding the statistics per each symbol is vanishing.

Joint work with Ahmad Beirami, Robert Calderbank, Mark Christiansen, Ken Duffy, Flavio du Pin Calmon, Mayank Varia

[pizza will be provided]

Spring 2015 Schedule

Wednesdays, 12-1pm, 182 George St, Room 110 [lunch is provided]

February 4, 2015 ABSTRACT WEBSITE

Computational reconstruction and modeling of multicellular dynamics from 3D+time in vivo imaging of animal early embryogenesis. Extension to Artificial Life.

René Doursat (CNRS/Ecole Polytechnique, Paris)

February 25, 2015 ABSTRACT WEBSITE

Scaling and Generalizing Variational Inference

David Blei (Columbia)


From Pixels to Local Layers: Exploring Flexible Representations for Motion Estimation

Deqing Sun (Harvard)


Using evolutionary sequence variation to make inferences about protein structure and function

Lucy Colwell (Cambridge)


Adaptive Bayesian Estimation of Conditional Densities

Andriy Norets (Brown)


Two Recent Information Theoretic Variations on the Theme of Patterns in Security

Muriel Medard (MIT)

October 21, 2015 WEBSITE

Survey of Recent Neural Signal Processing Results

Emery Brown (MIT/Harvard)

TBA (Fall 2015) WEBSITE

Constructing representations using Bayesian nonparametrics and connections between human knowledge, optimal foraging, and random walks on graphs

Joe Austerweil (Brown)

Fall 2014 Schedule

Wednesdays, 12-1pm, 182 George St, Room 110 [lunch is provided]

October 1, 2014 ABSTRACT WEBSITE

Statistical mechanics for real biological networks

William Bialek (Princeton)

October 8, 2014 ABSTRACT WEBSITE

A Simple Pattern-Theoretic Representation

Oren Freifeld (MIT)

October 22, 2014 ABSTRACT WEBSITE

Algorithms for Interpretable Machine Learning

Cynthia Rudin (MIT)

November 5, 2014 ABSTRACT WEBSITE

Cross-Study Validation versus Randomized Cross-Validation as Data Accumulate

Lo-Bin Chang (Johns Hopkins)

November 12, 2014 ABSTRACT WEBSITE

Multiscale models for shapes and images

Pedro Felzenszwalb (Brown)

Thursday, November 20, 2014 [4-5pm, Wilson 102] ABSTRACT WEBSITE

Joint Pattern Theory / LCDS Seminar

Geometric graph-based methods for high dimensional data

Andrea Bertozzi (UCLA)

December 3, 2014 ABSTRACT WEBSITE

Hypothesis-guided dimensionality reduction and its application to large-scale neuroscience

John Cunningham (Columbia)

2013-2014 Schedule


Division of Applied Mathematics / Center for Vision Research Seminar

Computational Anatomy, High Throughput Neuro-Imaging Informatics, and the BrainCloud

Michael Miller (Johns Hopkins)


Climate informatics: Recent advances and challenge problems for machine learning in climate science

Claire Monteleoni (George Washington University)


The Blended Paradigm: A Bayesian approach to handling outliers and misspecified models

Steven MacEachern (Ohio State)


Division of Applied Mathematics / Center for Vision Research Seminar

The computational magic of the ventral stream: a theory (and why some deep architectures work)

Tomaso Poggio (MIT)


Can connectomics help us understand neural computation? Insights from the fly visual system

Dmitri Chklovskii (Janelia Farm)


Robust inference on parameters via particle filters and sandwich covariance matrices

Neil Shephard (Harvard)

February 26, 2014 ABSTRACT WEBSITE

Productivity and reuse in language: Non-parametric Bayesian models of lexical acquisition

Timothy O'Donnell (MIT)

February 12, 2014 ABSTRACT WEBSITE

Challenging issues in likelihood inference on mixture models

Daeyoung Kim (UMass Amherst)

December 4, 2013 ABSTRACT WEBSITE

Big data in neuroscience: Where is the information?

Joachim Buhmann (ETH Zurich)

November 20, 2013 ABSTRACT WEBSITE

Interactive Demonstrations in the Brown Robotics Lab [in CIT 134]

Chad Jenkins (Brown)

November 6, 2013 ABSTRACT WEBSITE

Dirichlet process mixture inconsistency for the number of components, and dimension mixture models

Jeffrey Miller (Brown)

October 23, 2013 ABSTRACT WEBSITE

High-dimensional statistics

Sahand Negahban (Yale)

October 9, 2013 ABSTRACT WEBSITE

Model selection in a large compositional space

Roger Grosse (MIT)

September 11, 2013 ABSTRACT WEBSITE

Parameter estimation robust to low-frequency contamination

Adam McCloskey (Brown)

2012-2013 Schedule

May 8, 2013 ABSTRACT

Scale-invariance and metrics on spaces of plane curves

Matt Feiszli


Towards a general theory of human learning and reasoning

Charles Kemp (Carnegie Mellon)


Encoding binary neural codes in networks of threshold-linear neurons

Carina Curto (Nebraska-Lincoln)


Learning to behave by reading

Regina Barzilay (MIT)


Sparse superposition codes: Communication by regression

Andrew Barron (Yale)

February 27, 2013 ABSTRACT WEBSITE

Bayesian model sampling in reinforcement learning

Michael Littman (Brown)

February 20, 2013 ABSTRACT WEBSITE

Nonstationary modeling through dimension expansion

Luke Bornn (Harvard)

January 30, 2013 ABSTRACT WEBSITE

Composite likelihood

Nancy Reid (Toronto)

November 14, 2012 ABSTRACT WEBSITE

Linking signaling pathways and dynamic regulatory networks

Anthony Gitter (Microsoft Research)

November 7, 2012 ABSTRACT WEBSITE

Natural image statistics and image restoration

Yair Weiss (Hebrew University)

October 24, 2012 ABSTRACT WEBSITE

Active learning under margin assumptions

Sivan Sabato (Microsoft Research)

October 3, 2012 ABSTRACT WEBSITE

Recovering large networks via optimizing non-likelihood functions

Rossi Luo (Brown)

2011-2012 Schedule


Division of Applied Mathematics / Center for Vision Research Seminar

Lessons from photographing and identifying the world's plant species

Peter Belhumeur (Columbia)

May 9, 2012 ABSTRACT

Computational challenges in molecular medicine

Donald Geman (Johns Hopkins)

April 25, 2012 ABSTRACT

Hallucinating scene detail and recognizing scene attributes

James Hays (Brown)

April 18, 2012 ABSTRACT

LP relaxations for global models in natural language processing

Sebastian Riedel (UMass)

March 28, 2012 ABSTRACT

What is the neural foundation of the vision process?

Christoph von der Malsburg (Frankfurt IAS)

March 21, 2012 ABSTRACT

The tree of life and the evolution of genome function

Casey Dunn (Brown)

February 8, 2012 ABSTRACT

Exploiting sparse structure by spectral connectivity analysis

Ann Lee (Carnegie Mellon)

February 1, 2012 ABSTRACT

Statistical analysis of populations with interacting and interfering units

Edo Airoldi (Harvard)

November 30, 2011 ABSTRACT

Exploring the role of ventral premotor cortex in reach-to-grasp movements: neural trajectories through spike train similarity space

Carlos Vargas-Irwin (Brown)

November 2, 2011 ABSTRACT

Perceptual Fragments: Bottom-Up and Top-Down Use of Shape in Object Recognition

Benjamin Kimia (Brown)

October 19, 2011 ABSTRACT

Statistical challenges in neural data analysis

Liam Paninski (Columbia)

October 12, 2011 ABSTRACT

Spectral Methods for Learning Graphical Models

Sham Kakade (UPenn & MRNE)

October 5, 2011 ABSTRACT

Dynamic regulation of decision threshold by frontal cortex and basal ganglia

Michael Frank (Brown)

September 14, 2011 ABSTRACT

Non-parametric Priors for Segmentation of Medical Images

Polina Golland (MIT)

2010-2011 Schedule

May 11, 2011 ABSTRACT

Division of Applied Mathematics / Center for Vision Research Seminar

Statistical structures of natural scenes and neural ensembles activities

Tai Sing Lee (Carnegie Mellon)

May 4, 2011 ABSTRACT

Logistic Regression on Data Streams

Kevin Kochanek (US Department of Defense)

April 20, 2011 ABSTRACT

Self-folding of polyhedra-- experiments and a little theory

Govind Menon (Brown)

April 6, 2011 ABSTRACT

Division of Applied Mathematics / Center for Vision Research Seminar

A High-Throughput Screening Approach to Biologically-Inspired Object Recognition

David Cox (Rowland Institute at Harvard)

March 16, 2011 ABSTRACT

Solving Inference, Optimization, and Constraint Satisfaction Problems with the Divide & Concur and Belief Propagation Message-Passing Algorithms

Jonathan Yedidia (MERL)

March 9, 2011 ABSTRACT

A history of applying principal component analyses to human population genetic data

Sohini Ramachandran (Brown)

February 16, 2011 ABSTRACT

Patterns of Thought (in humanoid robots)

Yiannis Aloimonos (University of Maryland)

February 9, 2011 ABSTRACT

Division of Applied Mathematics / Center for Vision Research Seminar

Learning on Analytic Manifolds

Fatih Porikli (MERL)

November 17, 2010 ABSTRACT

Point process adaptive filters and the analysis of ensemble neural spiking activity

Uri Eden (Boston University)

November 3, 2010 ABSTRACT

Bottom-up and top-down processing in visual perception

Thomas Serre (Brown)

October 20, 2010 ABSTRACT

Discovering Influential Variables: A Partition Retention Approach

Herman Chernoff (Harvard)

October 6, 2010 ABSTRACT

(CIT 241, Swig Boardroom)

Learning Probabilistic Models with Deep Hierarchical Structures

Ruslan Salakhutdinov (MIT)

2009-2010 Schedule

May 10, 2010 ABSTRACT

Shared Segmentation of Natural Scenes using Dependent Pitman-Yor Processes

Erik Sudderth (Brown)

April 23, 2010 ABSTRACT

A Generative Model Approach to Fraud Detection

Brian Lucena (Guardian Analytics, Inc.)

April 21, 2010 ABSTRACT

Segmentation of Image Ensembles via Latent Atlases

Tammy Riklin-Raviv (MIT)

April 16, 2010 ABSTRACT

Applied Mathematics / Center for Statistical Sciences Seminar

Multi-Resolution Inference of Stochastic Models from Partially Observed Data

Samuel Kou (Harvard)

April 14, 2010 ABSTRACT

Preserving knowledge through media transitions: ushering the heritage of India into the digital age

Peter Scharf (Brown)

April 9, 2010 ABSTRACT

Analysis of Molecular Networks

Mark Gerstein (Yale)

April 7, 2010 ABSTRACT

Geometry of the space of 2D shapes equipped with the Weil-Petersson metric

Sergey Kushnarev (Brown)

March 24, 2010 ABSTRACT

Unsupervised Part of Speech Tagging: From graphical models to statistical models to "biological" models

Michael Lamar (Brown)

March 17, 2010 ABSTRACT

Learning in Social Networks with Signals of Bounded Informativeness

Ilan Lobel (Microsoft Research New England)

March 12, 2010 ABSTRACT

Graphs and polytopes: learning structures with linear programming relaxations

Tommi Jaakkola (MIT)

March 10, 2010 ABSTRACT

Respondent-Driven Sampling for Networks: Degrees of Uncertainty with Uncertain Degrees

Joe Blitzstein (Harvard)

March 3, 2010 ABSTRACT

Topic Models: Priors, Stop Words and Languages

Hanna Wallach (UMass)

February 17, 2010 ABSTRACT

Message Passing Algorithms for Compressed Sensing

Andrea Montanari (Stanford)

February 12, 2010 ABSTRACT

Applied Mathematics / Center for Vision Research Seminar

Learning Hierarchies of Sparse Visual Features

Yann LeCun (Courant)

February 3, 2010 ABSTRACT

An analysis of connectivity in neuronal population recordings

Asohan Amarasingham (Rutgers)

November 20, 2009 ABSTRACT

Applied Mathematics / Center for Statistical Sciences Seminar

Error controls for multiple hypothesis testing

Zhiyi Chi (U Conn)

November 18, 2009 ABSTRACT

Spectral Filtering Approaches to Machine Learning

Lorenzo Rosasco (MIT)

November 11, 2009 ABSTRACT

Generative Models for Image Analysis

Lo-Bin Chang (Brown)

November 6, 2009 ABSTRACT

Applied Mathematics / Center for Vision Research Seminar

Understanding Visual Scenes

Antonio Torralba (MIT)

November 2, 2009 ABSTRACT

Center for Statistical Sciences / Applied Mathematics Seminar

Application of Heteroskedastic Spatial Models to Computer Experiments

Richard A. Davis (Columbia)

October 28, 2009 ABSTRACT

Statistical Analysis of Climate Ecosystem Dynamics

Surajit Ray (Boston University)

October 21, 2009 ABSTRACT

Recent Advances on the Geometry of the Riemannian Manifold of Landmarks

Mario Micheli (UCLA)

October 14, 2009 ABSTRACT

SIFT Flow: Dense Scene Alignment and Its Applications

Ce Liu (Microsoft Research New England)

October 7, 2009 ABSTRACT

The probabilistic language of thought

Noah Goodman (MIT)

September 30, 2009 ABSTRACT

Learning maximum-entropy models of salience via EM

Micha Elsner (Brown)

September 23, 2009 ABSTRACT

Latent Socio-Spatial Process Model for Social Networks

Crystal Linkletter (Brown)

September 16, 2009 ABSTRACT

Organizational meeting & Conditional inference for non-stationary data

Matthew Harrison (Brown)