Yes! Don't assume that the Bible is in the public domain. Only some translations of it are.
The King James Version of the Bible, for example, is in the public domain. But the New International Version has a copyright license you have to adhere to! .
The copyright license depends on the particular translation you are using. Typically, the license simply is meant to target those who want to sell that version and not someone who is just quoting a few versus.
For example, the NIV limits you to copying more than 500 versus. Typically if you're quoting a short story or a few important versus, that's plenty enough. So it's more-so intended to dissuade people from reselling the entire thing without them seeing profits.
Definitely look up which translation you are using and see the copyright license for it. Or just stick with something in the public domain, like KJV and ASV.
Public domain beside some parts of the Bible was taken directly from other stories, from Sumerian Text to name one culture, the Assyrians and the Babylonians plagiarized the Sumerian accounts almost word for word, so should it bother us that Moses did the same?
There is no copyright on the Bible. It's far too old and no translator intends to make a profit from it. You can check with the publisher of the translation you are quoting (address on reverse side of the title page, and then check the internet to be sure it's up to date)
Many translations of the Bible ARE copyrighted and are NOT PUBLIC DOMAIN. The King James Version is of course public domain, but more recent versions may very well be subject to copyright. Check the front pages of the edition you're using.
One of my favorite webcomic artists did just that. "The Holy Bible: Abridged Beyond the Point of Usefulness". And for profit. That thing's so old, it's way past public domain.