Data · dataset · 2020
Reconstructing imagined letters from early visual cortex reveals tight topographic correspondence between visual mental imagery and perception
Listed in IISH Dataverse and ODISSEI Portal — shown once because both records carry DOI 10.34894/itwfzp
Visual mental imagery is the quasi-perceptual experience of “seeing in the mind’s eye”.
Description
While a tight correspondence between imagery and perception in terms of subjective experience is well established, their correspondence in terms of neural representations remains insufficiently understood. In the present study, we exploit the high spatial resolution of functional magnetic resonance imaging (fMRI) at 7T, the retinotopic organization of early visual cortex, and machine-learning techniques to investigate whether visual imagery of letter shapes preserves the topographic organization of perceived shapes.
Sub-millimeter resolution fMRI images were obtained from early visual cortex in six subjects performing visual imagery of four different letter shapes. Predictions of imagery voxel activation patterns based on a population receptive field-encoding model and physical letter stimuli provided first evidence in favor of detailed topographic organization. Subsequent visual field reconstructions of imagery data based on the inversion of the encoding model further showed that visual imagery preserves the geometric profile of letter shapes.
Read the rest (1 more)
These results open new avenues for decoding, as we show that a denoising auto encoder can be used to pretrain a classifier purely based on perceptual data before fine-tuning it on imagery data. Finally, we show that the auto encoder can project imagery-related voxel activations onto their perceptual counterpart allowing for visually recognizable reconstructions even at the single-trial level. The latter may eventually be utilized for the development of content-based BCI letter-speller systems.
Links
Where it is published
- Dataverse dataset page dataverse.nl/dataset.xhtml?persistentId=doi%3A10.34894%2FITWFZP ↗
landing page · from datasets iisg amsterdam
- Dataverse dataset page portal.odissei.nl/dataset.xhtml?persistentId=doi%3A10.34894%2FITWFZP ↗
landing page · from portal odissei nl
- DOI doi.org/10.34894/itwfzp ↗
DOI / persistent id · from datasets iisg amsterdam
Catalogue records · 2
- Dataverse API dataverse.nl/api/datasets/:persistentId/?persistentId=doi%3A10.34894%2FITWF… ↗
metadata API · from datasets iisg amsterdam
- Dataverse API portal.odissei.nl/api/datasets/:persistentId/?persistentId=doi%3A10.34894%2FITWF… ↗
metadata API · from portal odissei nl
Topics
- Stated by source
- Social Sciences · Social Sciences
- From keywords
- Social Science · Social Science
- Inferred from text
- Image 65% · Imaging 75% · Magnetic resonance imaging 75%
Provenance · 2 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| IISH Dataverse | doi:10.34894/ITWFZP | 12 d ago | JSON v1 |
| ODISSEI Portal | doi:10.34894/ITWFZP | 8 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].dataverse_subject:social-sciences | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /subjects |
| concepts[field].dataverse_subject:social-sciences | source · portal odissei nl | connector:portal_odissei_nl@1.0.0 | /subjects |
| concepts[field].local:field:social-science | mapping · portal odissei nl | connector:portal_odissei_nl@1.0.0 | /subjects |
| concepts[field].local:field:social-science | mapping · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /subjects |
| concepts[modality].local:modality:image | enrichment · datasets iisg amsterdam | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[modality].local:modality:imaging | enrichment · datasets iisg amsterdam | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[modality].local:modality:mri | enrichment · datasets iisg amsterdam | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | |
| description | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /description |
| publication_date | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | |
| title | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | /name |
| updated_date | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 | |
| version_label | source · datasets iisg amsterdam | connector:datasets_iisg_amsterdam@1.0.0 |