Addressing fluoride and nitrate contamination in groundwater is crucial for safeguarding public health. Fluoride contamination in groundwater can cause dental and skeletal fluorosis, along with potential neurotoxic effects. Nitrate contamination can lead to methemoglobinemia in infants and increase cancer risk due to the formation of nitrosamines. The major goal of this study was to examine groundwater quality in the Chickkaballapur urban (CBU) and Chikkaballapur rural (CBR) parts of the Chikkaballapur taluk (CBT), Karnataka, and to investigate the potential health hazards associated with the presence of fluoride and nitrate contaminants. Hazard quotient and total hazard index (THI) calculation methods, as suggested by the United States Environmental Protection Agency, were used in the present study to evaluate non-carcinogenic risks for individuals of various age categories, including men, women, and children (MWC). A total of 112 samples from rural areas and 41 samples from urban areas of Chikkaballapur taluk were collected during the post-monsoon season. According to the study’s findings, groundwater samples from CBU and CBR surpassed acceptable fluoride concentration limits by 41% and 40%, respectively, while samples from CBR exceeded acceptable nitrate limits by 17%, set by the Bureau of Indian Standards (1 mg/L for fluoride and 45 mg/L for nitrate). All CBU samples remained within the acceptable nitrate limits. The total non-carcinogenic health risks for MWC ranged from 0.34 to 2.18, 0.40 to 2.58, and 0.46 to 2.95, respectively, for CBU, and from 0.16 to 6.51, 0.19 to 7.69, and 0.21 to 8.80, respectively, for CBR. Furthermore, a significant percentage of the groundwater samples that were collected in CBU (60.98%, 68.29%, and 75.61%) and CBR (48.21%, 62.50%, and 73.21%) exceeded the THI limit for MWC (THI = 1). Hence, based on the health risk assessment, it is evident that children in the study area have greater health risks than men and women.