Im just trying to make my skinny arms bigger. Can just doing pushups and lifting a 25 pound dumbbell make me bigger?

i dont have any equipment that i can use to build biceps muscle especially a dumbbell. Any alternative way that i can use at home for building biceps muscle?
Is carrying chairs putting books on top effective? It might be stupid.

i'd like to work out my shoulders, back, and chest, but only have 1 dumbbell. What are some good exercises.