Regularity Perception

Members:

Shimian Zhang

Skanda Bharadwaj

Keaton Kraiger

Peilin Chai

Yanxi Liu

Abstract:

This is an era of pervasive big data, streaming in from all sorts of sensors such as medical scanners, surveillance cameras, smart appliances and cellphones. Even equipped with the most powerful hardware and software for data processing, one may still get lost in this massive collection of noisy data and miss "seeing the forest for the trees". This project addresses a fundamental issue in the data sciences: what are we looking for in a seemingly structure-less complex data set? Based on proven mathematical theories about symmetry and inspired by human vision, the investigator will construct a roadmap for discovering all possible potential patterns in these datasets and provide computationally effective tools to discover such patterns even in their distorted and disguised forms. Such a relentless pattern-seeking algorithm will illustrate the power of a "treasure hunt" type search, promote automatic pattern discovery, and fill a gap in current practice of data analysis, thus advancing data science. The outcome from this project will be applicable to data sets from diverse fields, from biomedical domains such as drug discovery, gene mapping and human movement monitoring, to computer vision applications like driverless car navigation, urban scene understanding, and anomalous activity detection for surveillance.

This research formulates a symmetry group theory-based regularity space and constructs a computational platform for pattern-seeking algorithms that are principle-driven and human perception-inspired. The transitions among zero states of the proposed regularity-space, guided by group theory and learned from human perception, will be governed by a seamless marriage with Bayesian probability theory. The two key ingredients of a pattern, minimum cells and inter-cell topology, will be explored extensively on large scale, multimodality, high dimensional real-world sensory data. The aims are to construct and validate computational tools facilitating effective unsupervised recurring pattern discovery, followed by recovering geometric transformations, and finally by quantitatively linking the full regularity-perception spectrum from regular, near-regular to irregular. The finiteness, uniqueness and completeness of this group theory-based regularity space will provide a sound computational framework to guide pattern seeking in general data science.

This research is funded in part by NSF Award #1909315 This research is also funded in part by NSF Award #1248076

Sub Goals:

	EscherNet 101
	Beyond Planar Symmetry: Modeling human perception of reflection and rotation symmetries in the wild		Recurring Pattern Detection as a Joint Optimization
	Regularity-driven Urban Scene Understanding based on lattice detection and mid-level feature extraction.		Dynamic Near-Regular Texture Tracking This project is dealing with large variable number of interacting targets with quite low resolution. This project is a middle ground between near regular texture tracking and tracking a variable number of interacting targets.T
	Curved (Glide) Reflection Symmetry Detection Detecting deformed reflection symmetry		Image De-fencing We introduce a novel image segmentation algorithm that uses translational symmetry as the primary foreground/background separation cue.