A parenthetical expression is an expression which is inserted into the flow of thought. It may be in the middle of a sentence or between sentences, but it does not deal directly with the topic at hand.
Some short parenthetical expressions like of course are set off by commas, but parenthetical expressions may also be set off by parentheses and dashes.