top of page
작성자 사진동규 김

Dim(N) Week 8 - Neural decoding of mental imagery

Dim(N) Week 8 - Nooroo Bae (22/08/24)

Neural decoding of mental imagery


[Paper]

Naoko K.-M., Shinji N., Kei M. (2024) Mental image reconstruction from human brain activity: Neural decoding of mental imagery via deep neural network-based Bayesian estimation, Neural Networks, 170, 349-363. https://doi.org/10.1016/j.neunet.2023.11.024.


[Abstract]

In this study, we have presented a machine learning method for visualizing subjective images in the human mind based on fMRI brain activity. While numerous previous studies provided machine learning methods to reconstruct visual stimuli from brain activity, the visualization of mental imagery had been left as a significant challenge. We enhanced one of the previous visual image reconstruction methods through the integration of Bayesian estimation and semantic assistance. The results not only highlight the efficacy of our proposed framework but also suggest its potential as a unique tool for directly delving into the subjective contents of the brain, encompassing phenomena such as illusions, hallucinations, and dreams.


[Summary]

Builds on Shen et al. (2019) by enhancing image reconstruction from brain activity.

Uses a Bayesian framework with DNNs (e.g., VGG19) and CLIP to decode brain signals.

Incorporates an image prior from VQGAN and uses the SGLD algorithm for sampling.

Successfully reconstructs seen and imagined images with improved accuracy and quality.

조회수 2회댓글 0개

최근 게시물

전체 보기

Dim(N) Week 15

[Abstract] 최근 뇌 영상 연구는 특정 뇌 영역의 활성화를 넘어, 뇌 전체의 연결망을 분석하는 방향으로 발전하고 있습니다. 뇌의 다양한 영역이 서로 연결되어 복잡한 네트워크를 형성하고, 이 네트워크의 상호작용이 인지 기능을 수행하는 데...

Dim(N) Week 14

[Abstract] 지금까지 발표했던 Bayesian Decision Model이 행동적인 측면만을 다뤘다면, 이번에는 Neural evidence로 어떻게 뒷받침될 수 있는지에 대하여 고전부터 최신논문까지 다뤄보려고 합니다. 필수는 아니지만,...

Dim(N) Week 13

[Abstract] BDM 1: Likelihood & cue combination Bayesian decision model의 아주 고전적인 짧은 논문 두편과 함께 다른 modality의 sensory information이 어떻게...

Comments


bottom of page