In this paper, we have investigated the dynamics of a Brownian particle in the presence of a magnetic field. The present investigation is generalized considering different kinds of force fields, magnetic field, and non-Markovian thermal bath. The properties of the Brownian particle have been calculated based on the multi-dimensional Fokker-Planck description of stochastic processes. It leads to the study of non-Markovian dynamics of a Brownian particle in the presence of a magnetic field in a simple way. Using the present simple method, we have identified several important signatures of magnetic field and non-Markovian thermal bath in the dynamics.