The truth is 95 percent of people on this planet are mixed to some degree. The average African American is just under a quarter European.That makes them racially comparable to a lot of Latinos, (current) Caribbean Islanders, and some other parts of the Americas (like Belize). The only difference being European countries of origin.
A lot of people in the US use basic racial terms to denote what a person is mostly described as. So I am perceived as "Black." The big difference is I use that term to denote African American and Afro Puerto Rican. I often say that I am not that racially different than African Americans, but I am very culturally (ethnically) different. I mean... A person can register with a Native American tribe with only 1/66th of blood. If what Black Americans say concerns you, then that should also raise an eyebrow. Period.
That being said: Both sides need to be logical. If someone is one quarter African and chooses not to identify as such: So be it. Plenty of people live their whole lives not knowing every part of who they are. It is problematic when this happens due to racism/self-hatred, but it's not inherently harmful. That being said: You are part of the plight. Why? Latino history is riddled with colorism (Blanqueamiento), and even outright racism (Antihaitianismo). The issues are there. There's a lot of outright denial of African (not American) contributions to who and what we are. Some may think it's not as severe as the US, but in my experience colorism and racism are both much more socially acceptable in some Latino communities.
https://en.wikipedia.org/wiki/Yoel_Romero#/media/File:Yoel_Romero.jpg
https://cdn.britannica.com/00/196500-050-1B660275/Roberto-Clemente-1968.jpg
I have an African American mother. Both of these men have a darker skin tone than me. Very few people in Cuba that look like Yoel identify as Afro-Cuban. But why? It doesn't make any sense. Race is a different conversation than ethnicity. That isn't to say that he should be considered African American. He barely speaks English, and spent most of his life in Cuba. But dude.... Plantanos aren't indigenous to the Americas. They came from Africa. Ever heard of Santeria? Just saying. Lots of Latino things are influenced by or come straight from Africa. I'm pushy about this just like Black Americans are. Let that part of Latino culture shine like everything else. Colorism is a big problem in Latin America. Maybe you don't see it, but I've dealt with it. My own family has hounded me to date people with a lighter skin tone. A lot of Latinos aren't unaware that saying that is offensive.
I'm not saying you have to put yourself in any box. I identify as "Black (to include Afro-Latino) and Latino." Ignorant people exists in all racial groups. No one has ever pegged me as being Latino upon first meeting me. I don't "look" Puerto Rican. If you have a racial profile similar to Africans or African Americans: You have every right to be offended when they try put you in a cultural box that you're not a part of. But there's also a chance you are racially similar to them. So you need to acknowledge that as well. You aren't making things better by denying it. Be mature enough to inform people that your culture and upbringing is different. Maybe you don't want to have a conversation about race. That's fine. But if you look like me or the pictures I've shown: Stop hating yourself.