Skip to content
Research / archived / 2025

Neural Dawn

A review and implementation project around Restricted Boltzmann Machines and Deep Belief Networks in PyTorch.

Jupyter Notebook PyTorch RBM DBN Generative Models
GitHub
Audiofool934/Neural-Dawn
Language
Jupyter Notebook
Stars
0
Last Push
2025.04.10
README Sync
2026.09.26
This is a subproject of the Generative-Model repository, a review of RBM and DBN with implementation in PyTorch.
[ Project Brief ]

Overview

Neural Dawn is an early generative-model project focused on Restricted Boltzmann Machines and Deep Belief Networks.

It combines review notes with PyTorch implementation work: MCMC-based maximum likelihood, Contrastive Divergence, conditional generation, and RBM-based classification experiments.

Why It Fits

The project belongs in the course-project archive as a marker of the older generative-model path: before diffusion and flow matching became the dominant language, energy-based models gave a different way to think about learning distributions.

[ Synced from GitHub README ]

Repository Document

source ↗

Deep Belief Network

--- 🏗️ work in progress 🏗️ ---

Overview

Model

RBM and GRBM

Training

MLE(MCMC), CD, and PCD

  • Maximum Likelihood Estimation (MLE) using MCMC
  • Contrastive Divergence (CD)
  • Persistent Contrastive Divergence (PCD)

As a Generative Model

Conditional Generation

RBM for conditional generation on MNIST

alt text

Generative Discriminator

RBM for generative discriminator on MNIST

Test set classification accuracy: 94.07%

References