What is claimed is:1. A semiconductor device comprising:an active pattern on a substrate, the active pattern defined by a device isolation layer; anda gate electrode on the active pattern and intersecting the active pattern,wherein the active pattern comprises:a first buffer pattern on the substrate;a channel pattern on the first buffer pattern;a doped pattern between the first buffer pattern and the channel pattern; anda second buffer pattern between the doped pattern and the channel pattern,wherein the doped pattern provides extra carriers to the channel pattern, andwherein a height of a bottom surface of the device isolation layer is lower than a height of a bottom surface of the first buffer pattern, and a height of a top surface of the device isolation layer is lower than a height of a bottom surface of the doped pattern such that an upper portion of the first buffer pattern is exposed by the device isolation layer.2. The semiconductor device of claim 1, wherein the doped pattern has a conductivity type of a P-type or an N-type.3. The semiconductor device of claim 1 wherein the doped pattern includes graphene injected with an impurity.4. The semiconductor device of claim 3, wherein the doped pattern has a crystal structure formed by substituting the impurity for some of carbon atoms of graphene.5. The semiconductor device of claim 3, wherein an impurity concentration of the doped pattern is higher than 1×106/cm and equal to or lower than 1×1012/cm.6. The semiconductor device of claim 1, wherein the first buffer pattern and the second buffer pattern include the same material.7. The semiconductor device of claim 1, wherein the active pattern further comprises: a barrier pattern on the channel pattern,wherein the channel pattern is disposed between the second buffer pattern and the barrier pattern, andwherein the channel pattern includes a material of which an energy band gap is smaller than those of the second buffer pattern and the barrier pattern.8. The semiconductor device of claim 7, wherein the channel pattern includes a III-V group compound.9. The semiconductor device of claim 1, wherein the active pattern includes an upper portion exposed by the device isolation layer, andwherein the doped pattern is in the upper portion of the active pattern.10. A semiconductor device comprising:an active pattern on a substrate;a device isolation layer on the substrate and on a side surface of the active pattern, the active pattern including an active fin exposed by the device isolation layer; anda gate electrode on the active pattern and intersecting the active pattern, the gate electrode covering top and side surfaces of the active fin and extending onto a top surface of the device isolation layer,wherein the active pattern comprises:a first buffer pattern on the substrate;a channel pattern on the first buffer pattern;a doped pattern between the first buffer pattern and the channel pattern; anda second buffer pattern between the doped pattern and the channel pattern,wherein the doped pattern includes graphene layer injected with impurities, and the doped pattern provides extra carriers to the channel pattern,wherein the doped pattern is in direct contact with the first buffer pattern, andwherein a height of the top surface of the device isolation layer is lower than a height of a bottom surface of the doped pattern such that an upper portion of the first buffer pattern is exposed by the device isolation layer, and a lower portion of the first buffer pattern is covered by the device isolation layer.11. The semiconductor device of claim 10, wherein the doped pattern has a crystal structure that some of carbon atoms of the graphene layer is substituted by the impurities.12. The semiconductor device of claim 10, wherein the active fin includes the doped pattern.13. The semiconductor device of claim 10, wherein the first buffer pattern and the second buffer pattern include the same material.14. The semiconductor device of claim 10, wherein a height of a bottom surface of the device isolation layer is lower than a height of a bottom surface of the first buffer pattern.15. The semiconductor device of claim 10, wherein a height of the top surface of the device isolation layer is higher than a top surface of the substrate and the height of the top surface of the device isolation layer is below a top of the first buffer pattern.16. The semiconductor device of claim 1, wherein a height of the top surface of the device isolation layer is higher than a top surface of the substrate and the height of the top surface of the device isolation layer is below a top of the first buffer pattern.