Yup, you definitely do not live in Midtown. It is a lot bigger than two square blocks. Wayne State University and Detroit Medical Center are both in Midtown, and both are far greater than two blocks... And they are just a small part of Midtown. Midtown is at least a square mile or two, if not a bit more.
And it is about a mile from the Detroit River. It is very possible to walk from the Detroit River to Midtown. It is a short walk through Downtown.