Notes

← Back to home

A collection of fragments of understanding in the pursuit of deeper questions.

Sejnowski's Infomax Network (ICA) Rule & Bienenstock-Cooper-Monroe (BCM) Rule

Sejnowski's Infomax Network (ICA) Rule Paper: "An Information-Maximisation Approach to Blind Separation and Blind Deconvolution".

The Infomax rule utilizes a nonlinear function and yields a method for implementing Independent Component Analysis (ICA).

Bienenstock-Cooper-Monroe Rule

image75

Activity is measured by y along the horizontal axis, and with no activity no change in weights takes place. Activity below a certain threshold θM\theta_{M} triggers the LTD regime, and activity above this threshold triggers the LTP regime. Measuring neuronal output across a certain window indicates that there is a biological basis for this. Above some threshold, the weight updates increased as the stimulation frequency was increased. This was tested experimentally in the hippocampus and primary visual cortex, stimulating inputs to a neuron and measuring its spiking frequency. In this experiment, below a stimulation frequency of about 10Hz the weight updates were negative, while above this stimulation frequency they were positive.

image76 image77 image78