On June 1, 1970, Gaye entered Motown's Hitsville U.S.A. studios to record "What's Going On". Immediately after learning about the song, many of Motown's musicians, known as The Funk Brothers noted that there was a different approach with Gaye's record from that used on other Motown recordings, and Gaye complicated matters by bringing in only a few of the members while bringing his own recruits, including drummer Chet Forest. Longtime Funk Brothers members Jack Ashford, James Jamerson and Eddie Brown participated in the recording. Jamerson was pulled into the recording studio by Gaye after he located Jamerson playing with a local band at a blues bar and Eli Fontaine, the saxophonist behind "Baby, I'm For Real", also participated in the recording. Jamerson, who could not sit properly on his seat after arriving to the session drunk, performed his bass riffs, written for him by the album's arranger David Van De Pitte, on the floor. Fontaine's alto saxophone riff to open the song was not originally intended. When Gaye heard the playback of what Fontaine thought was simply a demo, Gaye instantly decided that the riff was the ideal way to start the song. When Fontaine said he was "just goofing around", Gaye being pleased with the results replied, "Well, you goof off exquisitely. Thank you."
The laid-back sessions of the single were credited to lots of "marijuana smoke and rounds of Scotch". Gaye's trademark multi-layering vocal approach came off initially as an accident by engineers Steve Smith and Kenneth Sands. Sands later explained that Gaye had wanted him to bring him the two lead vocal takes for "What's Going On" for advice on which one he should use for the final song. Smith and Sands accidentally mixed the two lead vocal takes together. Gaye loved the sound and decided to keep it and use it for the duration of the album.
That September, Gaye approached Gordy with the "What's Going On" song while in California where Gordy had relocated. According to one account, Gordy disliked the song, allegedly calling it "the worst thing I ever heard in my life". As a result, Gaye angrily responded to Gordy's alleged putdown by going on strike until Gordy changed his mind. Gordy himself denied this claim, stating he loved the song's jazzy feel but cautioned Gaye that the sound was out of date of the sound of the times and also feared the loss of Gaye's crossover audience by releasing the political song. Gaye continued to record his own compositions during this time, some of which later made his 1973 album, Let's Get It On. Motown executive Harry Balk recalled trying to get Gordy to release the song at the end of the year, to which Gordy replied to him, "that Dizzy Gillespie stuff in the middle, that scatting, it's old." Gordy mentioned later that he feared no one would buy songs with a jazz influence after his attempt to be a record store owner of a jazz shop folded after a year, years prior to starting Motown. Most of Motown's Quality Control Department team also turned the song down, with Balk later stating that "they were used to the 'baby baby' stuff, and this was a little hard for them to grasp."
With the help of Motown sales executive Barney Ales, Harry Balk got the song released to record stores on January 20, 1971, sending 100,000 copies of the song without Gordy's knowledge, with another 100,000 copies sent after that success. Upon its release, the song became a hit and was Motown's fastest-selling single at the time, peaking at number 1 on the Hot Soul Singles Chart, and peaking at number 2 on the Billboard Hot 100. Stunned by the news, Gordy drove to Gaye's home to discuss making a complete album, stating Gaye could do what he wanted with his music if he finished the record within 30 days before the end of March and thus effectively giving him the right to produce his own albums. Gaye returned to Hitsville to record the rest of What's Going On, which took a mere ten business days between March 17 and March 30. The album's rhythm …