Apr 16 11:19:55 devstack cinder-volume[74068]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 11:19:55 devstack cinder-volume[74068]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 11:19:55 devstack cinder-volume[74068]: we strongly recommend against using it for new projects. Apr 16 11:19:55 devstack cinder-volume[74068]: If you are already using Eventlet, we recommend migrating to a different Apr 16 11:19:55 devstack cinder-volume[74068]: framework. For more detail see Apr 16 11:19:55 devstack cinder-volume[74068]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 11:19:55 devstack cinder-volume[74068]: import eventlet # noqa Apr 16 11:19:57 devstack cinder-volume[74068]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 11:19:57 devstack cinder-volume[74068]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 11:19:57 devstack cinder-volume[74068]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 11:19:57 devstack cinder-volume[74068]: INFO dbcounter [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Registered counter for database cinder Apr 16 11:19:57 devstack cinder-volume[74068]: DEBUG oslo_db.sqlalchemy.engines [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:19:57 devstack cinder-volume[74068]: DEBUG dbcounter [-] [74068] Writer thread running {{(pid=74068) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 11:19:57 devstack cinder-volume[74068]: INFO cinder.rpc [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 11:19:57 devstack cinder-volume[74068]: INFO cinder.rpc [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_db.sqlalchemy.engines [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:19:58 devstack cinder-volume[74068]: INFO cinder.volume.manager [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Determined volume DB was empty at startup. Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG cinder.volume.manager [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74068) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 11:19:58 devstack cinder-volume[74068]: INFO cinder.volume.manager [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 11:19:58 devstack cinder-volume[74068]: WARNING stevedore.named [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 11:19:58 devstack cinder-volume[74068]: WARNING castellan.key_manager [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 11:19:58 devstack cinder-volume[74068]: WARNING cinder.keymgr.conf_key_mgr [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG cinder.volume.drivers.lvm [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74068) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_concurrency.processutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_concurrency.processutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] CMD "cinder-rtstool verify" returned: 0 in 0.291s {{(pid=74068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_db.sqlalchemy.engines [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:19:58 devstack cinder-volume[74068]: INFO cinder.rpc [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 16 11:19:58 devstack cinder-volume[74068]: INFO cinder.rpc [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 16 11:19:58 devstack cinder-volume[74068]: WARNING stevedore.named [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 11:19:58 devstack cinder-volume[74068]: WARNING castellan.key_manager [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 11:19:58 devstack cinder-volume[74068]: INFO cinder.volume.manager [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_db.sqlalchemy.engines [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74068) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:19:58 devstack cinder-volume[74068]: INFO oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Starting 1 workers Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Started child 74174 {{(pid=74068) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Full set of CONF: {{(pid=74068) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] ******************************************************************************** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Configuration options gathered from: {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] ================================================================================ {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] allow_availability_zone_fallback = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] allow_compression_on_image_upload = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] allowed_direct_url_schemes = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] api_rate_limit = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] auth_strategy = keystone {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] az_cache_duration = 3600 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_availability_zone = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_host = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_stats_polling_interval = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backup_api_class = cinder.backup.api.API {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backup_name_template = backup-%s {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backup_use_same_host = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backup_use_temp_snapshot = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] chap_password = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] chap_username = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_internal_tenant_project_id = 225091130829427a8514b7b943b9717d {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_internal_tenant_user_id = 5a78e82ea96843cb9cab70f1aa11b43f {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cloned_volume_same_az = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cluster = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] compression_format = gzip {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] compute_api_class = cinder.compute.nova.API {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] config_dir = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] config_source = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] control_exchange = openstack {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] debug = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] default_availability_zone = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] default_group_type = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] default_volume_type = lvmdriver-1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] disk_geometry = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] driver_client_cert = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] driver_client_cert_key = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] driver_data_namespace = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] driver_ssl_cert_path = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] driver_ssl_cert_verify = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] driver_use_ssl = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] enable_force_upload = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] enable_new_services = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] enable_unsupported_driver = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] enabled_backends = ['lvmdriver-1'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] enforce_multipath_for_image_xfer = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] filter_function = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_api_insecure = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_api_servers = ['http://192.168.122.3/image'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_api_ssl_compression = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_ca_certificates_file = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_catalog_info = image:glance:publicURL {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_num_retries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance_request_timeout = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] goodness_function = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] graceful_shutdown_timeout = 5 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] group_api_class = cinder.group.api.API {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] host = devstack {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_compress_on_upload = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_conversion_address_space_limit = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_conversion_cpu_limit = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_conversion_disable = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_upload_use_cinder_backend = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_upload_use_internal_tenant = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_volume_cache_enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_volume_cache_max_count = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] image_volume_cache_max_size_gb = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] init_host_max_objects_retrieval = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] instance_format = [instance: %(uuid)s] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] iscsi_target_flags = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] iscsi_write_cache = on {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] iser_helper = tgtadm {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] iser_ip_address = 192.168.122.3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] iser_port = 3260 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_color = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_config_append = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_dir = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_file = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_options = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_rotate_interval = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_rotate_interval_type = days {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] log_rotation_type = none {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] max_age = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] max_logfile_count = 30 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] max_logfile_size_mb = 200 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] max_over_subscription_ratio = 20.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] message_reap_interval = 86400 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] message_ttl = 2592000 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] migration_create_volume_timeout_secs = 300 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] monkey_patch = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] monkey_patch_modules = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] my_ip = 192.168.122.3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] no_snapshot_gb_quota = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] num_iser_scan_tries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] num_shell_tries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] num_volume_device_scan_tries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] nvmeof_conn_info_version = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] nvmet_ns_id = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] nvmet_port_id = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] osapi_max_limit = 1000 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] osapi_volume_ext_list = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] osapi_volume_listen = 0.0.0.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] osapi_volume_listen_port = 8776 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] osapi_volume_use_ssl = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] osapi_volume_workers = 2 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] per_volume_size_limit = -1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] periodic_fuzzy_delay = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] periodic_interval = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] project_id_regex = [0-9a-f\-]+ {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] public_endpoint = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] publish_errors = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] quota_backup_gigabytes = 1000 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] quota_backups = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] quota_gigabytes = 1000 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] quota_groups = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] quota_snapshots = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] quota_volumes = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] rate_limit_burst = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] rate_limit_except_level = CRITICAL {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] rate_limit_interval = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] reinit_driver_count = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] replication_device = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] report_discard_supported = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] report_interval = 120 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] reservation_clean_interval = 86400 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] reservation_expire = 86400 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] reserved_image_namespaces = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] reserved_percentage = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] rpc_response_timeout = 120 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] run_external_periodic_tasks = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] scst_target_driver = iscsi {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] scst_target_iqn_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_down_time = 720 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] shell_completion = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] snapshot_name_template = snapshot-%s {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] snapshot_same_host = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] split_loggers = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] state_path = /opt/stack/data/cinder {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] storage_availability_zone = nova {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] storage_protocol = iSCSI {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] syslog_log_facility = LOG_USER {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] target_helper = lioadm {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] target_ip_address = 192.168.122.3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] target_port = 3260 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] target_protocol = iscsi {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] target_secondary_ip_addresses = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] trace_flags = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] transfer_api_class = cinder.transfer.api.API {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] transport_url = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] until_refresh = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] use_chap_auth = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] use_default_quota_class = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] use_journal = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] use_json = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] use_multipath_for_image_xfer = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] use_stderr = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] use_syslog = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] verify_glance_signatures = enabled {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_api_class = cinder.volume.api.API {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_backend_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_clear = zero {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_clear_ionice = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_clear_size = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_copy_bps_limit = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_dd_blocksize = 1M {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_name_template = volume-%s {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_service_inithost_offload = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volume_usage_audit_period = month {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] zoning_mode = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_concurrency.disable_process_locking = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.admin_password = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.admin_token = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.admin_user = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_admin_prefix = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_port = 35357 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_protocol = https {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_section = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_type = password {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_uri = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.auth_version = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.cache = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.delay_auth_decision = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.http_connect_timeout = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.identity_uri = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.include_service_catalog = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.insecure = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.interface = public {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74174]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_password = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcache_username = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.region_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.service_token_roles_required = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.service_type = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.token_cache_time = 300 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.3/identity {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.backend = dogpile.cache.null {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.backend_argument = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.backend_expiration_time = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.config_prefix = cache.oslo {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.debug_cache_backend = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.enable_retry_client = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.enable_socket_keepalive = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.enforce_fips_mode = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.expiration_time = 600 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.hashclient_retry_attempts = 2 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.memcache_dead_retry = 300 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.memcache_pool_maxsize = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.memcache_sasl_enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.password = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.proxies = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.redis_db = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.redis_sentinel_service_name = mymaster {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.redis_server = localhost:6379 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.retry_attempts = 2 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.retry_delay = 0.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.socket_keepalive_count = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.socket_keepalive_idle = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.socket_keepalive_interval = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.socket_timeout = 1.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.tls_allowed_ciphers = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.tls_cafile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.tls_certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.tls_enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.tls_keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cache.username = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] coordination.backend_url = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.asyncio_connection = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.asyncio_slave_connection = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.backend = sqlalchemy {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.connection = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.connection_debug = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.connection_parameters = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.connection_recycle_time = 3600 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.connection_trace = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.db_inc_retry_interval = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.db_max_retries = 20 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.db_max_retry_interval = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.db_retry_interval = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.max_overflow = 50 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.max_pool_size = 5 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.max_retries = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.mysql_wsrep_sync_wait = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.pool_timeout = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.retry_interval = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.slave_connection = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.sqlite_synchronous = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.synchronous_reader = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] database.use_db_reconnect = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.connection_string = messaging:// {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.es_doc_type = notification {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.es_scroll_size = 10000 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.es_scroll_time = 2m {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.filter_error_trace = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.hmac_keys = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.sentinel_service_name = mymaster {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.socket_timeout = 0.1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.trace_requests = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler.trace_sqlalchemy = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler_jaeger.process_tags = {} {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler_jaeger.service_name_prefix = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] profiler_otlp.service_name_prefix = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.enforce_new_defaults = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: WARNING oslo_config.cfg [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.enforce_scope = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.policy_default_rule = default {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.policy_file = policy.yaml {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_policy.remote_timeout = 60.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] privsep_osbrick.group = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] privsep_osbrick.helper_command = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74174]: INFO cinder.volume.manager [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] privsep_osbrick.user = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_sys_admin.group = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_sys_admin.helper_command = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] cinder_sys_admin.user = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.auth_section = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.auth_type = password {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.cafile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.collect_timing = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.insecure = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.send_service_user_token = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.split_loggers = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] service_user.timeout = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.auth_section = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.auth_type = password {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.collect_timing = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.insecure = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.region_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.split_loggers = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] glance.timeout = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.backend_availability_zone = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.chap_password = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.chap_username = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.disk_geometry = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.driver_client_cert = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.driver_client_cert_key = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.driver_data_namespace = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.driver_use_ssl = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:19:58 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.enable_unsupported_driver = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.extra_capabilities = {} {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.filter_function = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.goodness_function = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.iscsi_target_flags = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.iscsi_write_cache = on {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:19:58 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.iser_helper = tgtadm {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.iser_ip_address = 192.168.122.3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.iser_port = 3260 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.lvm_mirrors = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.lvm_share_target = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.lvm_type = auto {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.num_shell_tries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.nvmet_port_id = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.replication_device = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.report_discard_supported = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.reserved_percentage = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.scst_target_driver = iscsi {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.scst_target_iqn_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.storage_protocol = iSCSI {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.target_helper = tgtadm {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.target_ip_address = 192.168.122.3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.target_port = 3260 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.target_protocol = iscsi {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.trace_flags = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.unique_fqdn_network = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.use_chap_auth = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_backend_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_clear = zero {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_clear_ionice = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_clear_size = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volume_group = cinder-volumes {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_reports.file_event_handler = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_reports.log_dir = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.backend_availability_zone = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.backend_host = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.chap_password = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.chap_username = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.chiscsi_conf = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.disk_geometry = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.driver_client_cert = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.driver_data_namespace = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.driver_use_ssl = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.extra_capabilities = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.filter_function = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.goodness_function = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.iser_helper = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.iser_ip_address = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.iser_port = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.iser_target_prefix = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.lvm_conf_file = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.lvm_mirrors = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.lvm_share_target = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.lvm_type = auto {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.num_shell_tries = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.nvmet_port_id = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.replication_device = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.report_discard_supported = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.reserved_percentage = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.scst_target_driver = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.storage_protocol = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.target_helper = lioadm {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.target_ip_address = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.target_port = 3260 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.target_protocol = iscsi {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.trace_flags = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.use_chap_auth = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_clear = zero {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_clear_size = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] lvmdriver-1.volumes_dir = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack sudo[74179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 16 11:19:58 devstack sudo[74179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.ssl = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.ssl_version = {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_notifications.driver = [] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_notifications.retry = -1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] oslo_messaging_notifications.transport_url = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] key_manager.fixed_key = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.barbican_api_version = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.barbican_endpoint = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.barbican_endpoint_type = public {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.barbican_region_name = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.cafile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.collect_timing = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.insecure = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.number_of_retries = 60 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.retry_delay = 1 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.send_service_user_token = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.split_loggers = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.timeout = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.verify_ssl = True {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican.verify_ssl_path = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.auth_section = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.auth_type = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.cafile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.certfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.collect_timing = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.insecure = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.keyfile = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.split_loggers = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] barbican_service_user.timeout = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.approle_role_id = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.approle_secret_id = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.kv_mountpoint = secret {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.kv_path = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.kv_version = 2 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.namespace = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.root_token_id = **** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.ssl_ca_crt_file = None {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.timeout = 60.0 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.use_ssl = False {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:19:58 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] ******************************************************************************** {{(pid=74068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 11:19:59 devstack sudo[74179]: pam_unix(sudo:session): session closed for user root Apr 16 11:19:59 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:19:59 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:59 devstack sudo[74236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:19:59 devstack sudo[74236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:19:59 devstack sudo[74236]: pam_unix(sudo:session): session closed for user root Apr 16 11:19:59 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.581s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:19:59 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:19:59 devstack cinder-volume[74174]: INFO cinder.brick.local_dev.lvm [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 16 11:19:59 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:59 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:19:59 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:19:59 devstack sudo[74511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:19:59 devstack sudo[74511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:00 devstack sudo[74511]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:00 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.523s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:00 devstack cinder-volume[74174]: DEBUG cinder.brick.local_dev.lvm [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74174) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 16 11:20:00 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:00 devstack sudo[74700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:00 devstack sudo[74700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:01 devstack sudo[74700]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.986s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:01 devstack sudo[74868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:01 devstack sudo[74868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:01 devstack sudo[74868]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:01 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:01 devstack sudo[74872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 16 11:20:01 devstack sudo[74872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:02 devstack sudo[74872]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:02 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.433s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:02 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:02 devstack sudo[74875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:20:02 devstack sudo[74875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:02 devstack sudo[74875]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:02 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:02 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:02 devstack sudo[74880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:20:02 devstack sudo[74880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:03 devstack sudo[74880]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:03 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:03 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:03 devstack sudo[74887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:20:03 devstack sudo[74887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:03 devstack sudo[74887]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:03 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:03 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:03 devstack sudo[74893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:03 devstack sudo[74893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:04 devstack sudo[74893]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:04 devstack sudo[74897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:04 devstack sudo[74897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:04 devstack sudo[74897]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.477s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:04 devstack cinder-volume[74174]: INFO cinder.volume.drivers.lvm [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:04 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:04 devstack sudo[74907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:04 devstack sudo[74907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:05 devstack sudo[74907]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:05 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:05 devstack cinder-volume[74174]: DEBUG cinder.volume.drivers.lvm [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Updating volume stats {{(pid=74174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 11:20:05 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:05 devstack sudo[75021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:20:05 devstack sudo[75021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:05 devstack sudo[75021]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:05 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:05 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:05 devstack sudo[75027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:20:05 devstack sudo[75027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:05 devstack sudo[75027]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:05 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:05 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:06 devstack sudo[75165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:06 devstack sudo[75165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:06 devstack sudo[75165]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:06 devstack sudo[75168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:20:06 devstack sudo[75168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:06 devstack sudo[75168]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:06 devstack cinder-volume[74174]: INFO cinder.volume.driver [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG cinder.volume.driver [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74174) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG oslo_db.sqlalchemy.engines [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG dbcounter [-] [74174] Writer thread running {{(pid=74174) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG cinder.db.sqlalchemy.api [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Building query based on filter {{(pid=74174) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG cinder.image.image_utils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74174) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 11:20:06 devstack cinder-volume[74174]: INFO cinder.keymgr.migration [None req-93ce1103-5bf0-46da-a8df-108a36cef980 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG cinder.volume.drivers.lvm [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Updating volume stats {{(pid=74174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 11:20:06 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:06 devstack sudo[75173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:20:06 devstack sudo[75173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:07 devstack sudo[75173]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:07 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:07 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:07 devstack sudo[75179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:20:07 devstack sudo[75179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:08 devstack sudo[75179]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:08 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:08 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:08 devstack sudo[75215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:08 devstack sudo[75215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:08 devstack cinder-volume[74068]: DEBUG dbcounter [-] [74068] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74068) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:20:08 devstack sudo[75215]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:08 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.538s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:08 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:08 devstack sudo[75222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:20:08 devstack sudo[75222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:09 devstack sudo[75222]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG cinder.manager [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Notifying Schedulers of capabilities ... {{(pid=74174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:20:09 devstack cinder-volume[74174]: INFO cinder.volume.manager [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Driver initialization completed successfully. Apr 16 11:20:09 devstack cinder-volume[74174]: INFO cinder.manager [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Initiating service 2 cleanup Apr 16 11:20:09 devstack cinder-volume[74174]: INFO cinder.manager [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Service 2 cleanup completed. Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG cinder.service [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Creating RPC server for service cinder-volume {{(pid=74174) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG cinder.service [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74174) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 11:20:09 devstack cinder-volume[74174]: INFO cinder.volume.manager [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG cinder.volume.drivers.lvm [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Updating volume stats {{(pid=74174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:09 devstack sudo[75230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:20:09 devstack sudo[75230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:09 devstack sudo[75230]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:09 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:09 devstack sudo[75233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:20:09 devstack sudo[75233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:10 devstack sudo[75233]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:10 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:10 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:10 devstack sudo[75254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:20:10 devstack sudo[75254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:10 devstack sudo[75254]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:10 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:10 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:20:10 devstack sudo[75293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:20:10 devstack sudo[75293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:20:10 devstack sudo[75293]: pam_unix(sudo:session): session closed for user root Apr 16 11:20:10 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:20:11 devstack cinder-volume[74174]: INFO cinder.volume.manager [None req-95c92c66-113c-47a8-9e9e-f9f6e977be34 None None] Driver post RPC initialization completed successfully. Apr 16 11:20:19 devstack cinder-volume[74174]: DEBUG dbcounter [-] [74174] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74174) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:20:21 devstack cinder-volume[74174]: DEBUG dbcounter [-] [74174] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=74174) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:21:33 devstack cinder-volume[74174]: DEBUG oslo_service.periodic_task [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74174) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:21:33 devstack cinder-volume[74174]: DEBUG cinder.volume.drivers.lvm [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Updating volume stats {{(pid=74174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 11:21:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:21:33 devstack sudo[80157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:21:33 devstack sudo[80157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:21:33 devstack sudo[80157]: pam_unix(sudo:session): session closed for user root Apr 16 11:21:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:21:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:21:33 devstack sudo[80167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:21:33 devstack sudo[80167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:21:33 devstack sudo[80167]: pam_unix(sudo:session): session closed for user root Apr 16 11:21:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:21:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:21:33 devstack sudo[80176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:21:33 devstack sudo[80176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:21:34 devstack sudo[80176]: pam_unix(sudo:session): session closed for user root Apr 16 11:21:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:21:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:21:34 devstack sudo[80187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:21:34 devstack sudo[80187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:21:34 devstack sudo[80187]: pam_unix(sudo:session): session closed for user root Apr 16 11:21:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:21:34 devstack cinder-volume[74174]: DEBUG cinder.manager [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Notifying Schedulers of capabilities ... {{(pid=74174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:22:21 devstack cinder-volume[74174]: DEBUG dbcounter [-] [74174] Writing DB stats cinder:SELECT=1 {{(pid=74174) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:22:21 devstack cinder-volume[74174]: DEBUG dbcounter [-] [74174] Writing DB stats cinder:UPDATE=1 {{(pid=74174) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:22:33 devstack cinder-volume[74174]: DEBUG oslo_service.periodic_task [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74174) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:22:33 devstack cinder-volume[74174]: DEBUG cinder.volume.drivers.lvm [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Updating volume stats {{(pid=74174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 11:22:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:22:33 devstack sudo[82056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:22:33 devstack sudo[82056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:22:33 devstack sudo[82056]: pam_unix(sudo:session): session closed for user root Apr 16 11:22:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:22:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:22:33 devstack sudo[82059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:22:33 devstack sudo[82059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:22:33 devstack sudo[82059]: pam_unix(sudo:session): session closed for user root Apr 16 11:22:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:22:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:22:33 devstack sudo[82074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:22:33 devstack sudo[82074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:22:34 devstack sudo[82074]: pam_unix(sudo:session): session closed for user root Apr 16 11:22:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:22:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:22:34 devstack sudo[82077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:22:34 devstack sudo[82077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:22:34 devstack sudo[82077]: pam_unix(sudo:session): session closed for user root Apr 16 11:22:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:22:34 devstack cinder-volume[74174]: DEBUG cinder.manager [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Notifying Schedulers of capabilities ... {{(pid=74174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:23:31 devstack cinder-volume[74068]: INFO oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Caught SIGTERM, stopping children Apr 16 11:23:31 devstack cinder-volume[74068]: DEBUG oslo_concurrency.lockutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Acquiring lock "singleton_lock" {{(pid=74068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 11:23:31 devstack cinder-volume[74068]: DEBUG oslo_concurrency.lockutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Acquired lock "singleton_lock" {{(pid=74068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 11:23:31 devstack cinder-volume[74068]: DEBUG oslo_concurrency.lockutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Releasing lock "singleton_lock" {{(pid=74068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 11:23:31 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Stop services. {{(pid=74068) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 11:23:31 devstack cinder-volume[74068]: DEBUG oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Killing children. {{(pid=74068) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 11:23:31 devstack cinder-volume[74068]: INFO oslo_service.backend._eventlet.service [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Waiting on 1 children to exit Apr 16 11:23:33 devstack cinder-volume[74174]: DEBUG oslo_service.periodic_task [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74174) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:23:33 devstack cinder-volume[74174]: DEBUG cinder.volume.drivers.lvm [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Updating volume stats {{(pid=74174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 11:23:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:33 devstack sudo[83257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 11:23:33 devstack sudo[83257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:33 devstack sudo[83257]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:33 devstack sudo[83260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:23:33 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:33 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:33 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:33 devstack sudo[83264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 11:23:33 devstack sudo[83264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:34 devstack sudo[83264]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:34 devstack sudo[83267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 11:23:34 devstack sudo[83267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:34 devstack sudo[83267]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:34 devstack cinder-volume[74174]: DEBUG oslo_concurrency.processutils [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=74174) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:34 devstack cinder-volume[74174]: DEBUG cinder.manager [None req-f4030fa0-4321-4949-a4e2-397c80271fb2 None None] Notifying Schedulers of capabilities ... {{(pid=74174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:23:36 devstack cinder-volume[74174]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 16 11:23:36 devstack cinder-volume[83271]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 11:23:36 devstack cinder-volume[83271]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 11:23:36 devstack cinder-volume[83271]: we strongly recommend against using it for new projects. Apr 16 11:23:36 devstack cinder-volume[83271]: If you are already using Eventlet, we recommend migrating to a different Apr 16 11:23:36 devstack cinder-volume[83271]: framework. For more detail see Apr 16 11:23:36 devstack cinder-volume[83271]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 11:23:36 devstack cinder-volume[83271]: import eventlet # noqa Apr 16 11:23:38 devstack cinder-volume[83271]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83271) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 11:23:38 devstack cinder-volume[83271]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83271) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 11:23:38 devstack cinder-volume[83271]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83271) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 11:23:39 devstack cinder-volume[83271]: INFO dbcounter [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Registered counter for database cinder Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_db.sqlalchemy.engines [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG dbcounter [-] [83271] Writer thread running {{(pid=83271) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 11:23:39 devstack cinder-volume[83271]: INFO cinder.rpc [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 11:23:39 devstack cinder-volume[83271]: INFO cinder.rpc [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_db.sqlalchemy.engines [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:39 devstack cinder-volume[83271]: INFO cinder.volume.manager [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Determined volume DB was empty at startup. Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG cinder.volume.manager [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83271) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 11:23:39 devstack cinder-volume[83271]: INFO cinder.volume.manager [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 11:23:39 devstack cinder-volume[83271]: WARNING stevedore.named [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 11:23:39 devstack cinder-volume[83271]: WARNING castellan.key_manager [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 11:23:39 devstack cinder-volume[83271]: WARNING cinder.keymgr.conf_key_mgr [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 11:23:39 devstack cinder-volume[83271]: INFO cinder.volume.manager [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_db.sqlalchemy.engines [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83271) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:39 devstack cinder-volume[83271]: INFO oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Starting 1 workers Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Started child 83394 {{(pid=83271) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Full set of CONF: {{(pid=83271) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] ******************************************************************************** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Configuration options gathered from: {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] ================================================================================ {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] allow_availability_zone_fallback = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] allow_compression_on_image_upload = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] allowed_direct_url_schemes = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] api_rate_limit = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83394]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] auth_strategy = keystone {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_availability_zone = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_host = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_stats_polling_interval = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backup_api_class = cinder.backup.api.API {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backup_name_template = backup-%s {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backup_use_same_host = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backup_use_temp_snapshot = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] chap_password = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] chap_username = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_internal_tenant_project_id = 225091130829427a8514b7b943b9717d {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_internal_tenant_user_id = 5a78e82ea96843cb9cab70f1aa11b43f {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cluster = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] compression_format = gzip {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] compute_api_class = cinder.compute.nova.API {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] config_dir = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] config_source = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] control_exchange = openstack {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] debug = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] default_availability_zone = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] default_group_type = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] default_volume_type = QuobyteHD {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] disk_geometry = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] driver_client_cert = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] driver_client_cert_key = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] driver_data_namespace = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] driver_ssl_cert_path = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] driver_ssl_cert_verify = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] driver_use_ssl = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] enable_new_services = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] enable_unsupported_driver = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] enabled_backends = ['QuobyteHD'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] enforce_multipath_for_image_xfer = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] filter_function = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_api_insecure = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_api_servers = ['http://192.168.122.3/image'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_api_ssl_compression = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_ca_certificates_file = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_catalog_info = image:glance:publicURL {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_num_retries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance_request_timeout = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] goodness_function = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] graceful_shutdown_timeout = 5 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] group_api_class = cinder.group.api.API {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] host = devstack {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_compress_on_upload = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_conversion_address_space_limit = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_conversion_cpu_limit = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_conversion_disable = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_upload_use_cinder_backend = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_upload_use_internal_tenant = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_volume_cache_enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_volume_cache_max_count = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] image_volume_cache_max_size_gb = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] init_host_max_objects_retrieval = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] instance_format = [instance: %(uuid)s] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] iscsi_target_flags = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] iscsi_write_cache = on {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] iser_helper = tgtadm {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] iser_ip_address = 192.168.122.3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] iser_port = 3260 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_color = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_config_append = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_dir = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_file = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_options = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_rotate_interval = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_rotate_interval_type = days {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] log_rotation_type = none {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] max_age = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] max_logfile_count = 30 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] max_logfile_size_mb = 200 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] max_over_subscription_ratio = 20.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] message_reap_interval = 86400 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] message_ttl = 2592000 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] migration_create_volume_timeout_secs = 300 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] monkey_patch = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] monkey_patch_modules = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] my_ip = 192.168.122.3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] no_snapshot_gb_quota = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] num_iser_scan_tries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] num_shell_tries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] num_volume_device_scan_tries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] nvmeof_conn_info_version = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] nvmet_ns_id = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] nvmet_port_id = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] osapi_max_limit = 1000 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] osapi_volume_ext_list = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] osapi_volume_listen = 0.0.0.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] osapi_volume_listen_port = 8776 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] osapi_volume_use_ssl = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] osapi_volume_workers = 2 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] per_volume_size_limit = -1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] periodic_fuzzy_delay = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] periodic_interval = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] project_id_regex = [0-9a-f\-]+ {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] public_endpoint = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] publish_errors = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] quota_backup_gigabytes = 1000 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] quota_backups = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] quota_gigabytes = 1000 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] quota_groups = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] quota_snapshots = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] quota_volumes = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] rate_limit_burst = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] rate_limit_except_level = CRITICAL {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] rate_limit_interval = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] reinit_driver_count = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] replication_device = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] report_discard_supported = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] report_interval = 120 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] reservation_clean_interval = 86400 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] reservation_expire = 86400 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] reserved_image_namespaces = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] reserved_percentage = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] rpc_response_timeout = 120 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] run_external_periodic_tasks = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] scst_target_driver = iscsi {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] scst_target_iqn_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_down_time = 720 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] shell_completion = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] snapshot_name_template = snapshot-%s {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] split_loggers = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] state_path = /opt/stack/data/cinder {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] storage_availability_zone = nova {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] storage_protocol = iSCSI {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] syslog_log_facility = LOG_USER {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83394]: INFO cinder.volume.manager [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] target_helper = lioadm {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.remotefs [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83394) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] target_ip_address = 192.168.122.3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] target_port = 3260 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] target_protocol = iscsi {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] target_secondary_ip_addresses = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] trace_flags = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] transfer_api_class = cinder.transfer.api.API {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] transport_url = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] until_refresh = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] use_chap_auth = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] use_default_quota_class = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] use_journal = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] use_json = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] use_multipath_for_image_xfer = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] use_stderr = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] use_syslog = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] verify_glance_signatures = enabled {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_api_class = cinder.volume.api.API {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_backend_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_clear = zero {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_clear_ionice = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_clear_size = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_copy_bps_limit = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_dd_blocksize = 1M {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_name_template = volume-%s {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_service_inithost_offload = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volume_usage_audit_period = month {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] zoning_mode = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_concurrency.disable_process_locking = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.admin_password = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.admin_token = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.admin_user = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_admin_prefix = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_port = 35357 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_protocol = https {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_section = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_type = password {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_uri = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.auth_version = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.cache = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.delay_auth_decision = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.http_connect_timeout = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.identity_uri = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.include_service_catalog = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.insecure = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.interface = public {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_password = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcache_username = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.region_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.service_token_roles_required = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.service_type = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.token_cache_time = 300 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.3/identity {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.backend = dogpile.cache.null {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.backend_argument = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.backend_expiration_time = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.config_prefix = cache.oslo {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.debug_cache_backend = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.enable_retry_client = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.enable_socket_keepalive = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.enforce_fips_mode = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.expiration_time = 600 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.hashclient_retry_attempts = 2 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.memcache_dead_retry = 300 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.memcache_pool_maxsize = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.memcache_sasl_enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.password = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.proxies = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.redis_db = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.redis_sentinel_service_name = mymaster {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.redis_server = localhost:6379 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.retry_attempts = 2 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.retry_delay = 0.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.socket_keepalive_count = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.socket_keepalive_idle = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.socket_keepalive_interval = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.socket_timeout = 1.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.tls_allowed_ciphers = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.tls_cafile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.tls_certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.tls_enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.tls_keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cache.username = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] coordination.backend_url = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.asyncio_connection = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.asyncio_slave_connection = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.backend = sqlalchemy {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.connection = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.connection_debug = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.connection_parameters = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.connection_recycle_time = 3600 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.connection_trace = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.db_inc_retry_interval = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.db_max_retries = 20 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.db_max_retry_interval = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.db_retry_interval = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.max_overflow = 50 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.max_pool_size = 5 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.max_retries = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.mysql_wsrep_sync_wait = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.pool_timeout = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.retry_interval = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.slave_connection = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.sqlite_synchronous = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.synchronous_reader = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] database.use_db_reconnect = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.connection_string = messaging:// {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.es_doc_type = notification {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.es_scroll_size = 10000 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.es_scroll_time = 2m {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.filter_error_trace = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.hmac_keys = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.sentinel_service_name = mymaster {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.socket_timeout = 0.1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.trace_requests = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler.trace_sqlalchemy = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler_jaeger.process_tags = {} {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler_jaeger.service_name_prefix = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] profiler_otlp.service_name_prefix = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.enforce_new_defaults = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: WARNING oslo_config.cfg [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.enforce_scope = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.policy_default_rule = default {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.policy_file = policy.yaml {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_policy.remote_timeout = 60.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] privsep_osbrick.group = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] privsep_osbrick.helper_command = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83394) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] privsep_osbrick.user = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_sys_admin.group = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_sys_admin.helper_command = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83394]: WARNING cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83394]: WARNING cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] cinder_sys_admin.user = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.auth_section = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.auth_type = password {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.cafile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Running cmd (subprocess): mount.quobyte {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.collect_timing = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.insecure = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.send_service_user_token = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.split_loggers = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] service_user.timeout = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.auth_section = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.auth_type = password {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.collect_timing = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.insecure = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.region_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.split_loggers = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] glance.timeout = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.backend_availability_zone = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.chap_password = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.chap_username = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.disk_geometry = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.driver_client_cert = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.driver_client_cert_key = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.driver_data_namespace = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.driver_use_ssl = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.enable_unsupported_driver = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.extra_capabilities = {} {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.filter_function = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.goodness_function = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.iscsi_target_flags = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.iscsi_write_cache = on {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.iser_helper = tgtadm {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.iser_ip_address = 192.168.122.3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.iser_port = 3260 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_host = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_login = admin {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_mount_options = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_password = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_private_key = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_share_path = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_ssh_port = 22 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.num_shell_tries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.nvmet_port_id = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.quobyte_client_cfg = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.quobyte_volume_url = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.replication_device = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.report_discard_supported = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.reserved_percentage = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.scst_target_driver = iscsi {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.scst_target_iqn_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.storage_protocol = iSCSI {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.target_helper = tgtadm {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.target_ip_address = 192.168.122.3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.target_port = 3260 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.target_protocol = iscsi {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.trace_flags = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.unique_fqdn_network = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.use_chap_auth = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_backend_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_clear = zero {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_clear_ionice = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_clear_size = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_reports.file_event_handler = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_reports.log_dir = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.backend_availability_zone = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.backend_host = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.chap_password = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.chap_username = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.chiscsi_conf = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.disk_geometry = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.driver_client_cert = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.driver_client_cert_key = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.driver_data_namespace = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.driver_use_ssl = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.extra_capabilities = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.filter_function = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.goodness_function = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.iscsi_target_flags = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.iscsi_write_cache = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.iser_helper = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.iser_ip_address = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.iser_port = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.iser_target_prefix = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_host = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_login = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_mount_options = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_password = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_private_key = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_share_path = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_ssh_port = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.num_shell_tries = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nvmet_ns_id = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.nvmet_port_id = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.replication_device = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.report_discard_supported = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.reserved_percentage = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.scst_target_driver = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.storage_protocol = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.target_helper = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.target_ip_address = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.target_port = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.target_prefix = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.target_protocol = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.trace_flags = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.unique_fqdn_network = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.use_chap_auth = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_clear = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_clear_ionice = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_clear_size = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] QuobyteHD.volumes_dir = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.ssl = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.ssl_version = {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_notifications.driver = [] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_notifications.retry = -1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] oslo_messaging_notifications.transport_url = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] key_manager.fixed_key = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.barbican_api_version = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.barbican_endpoint = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.barbican_endpoint_type = public {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.barbican_region_name = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.cafile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.collect_timing = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.insecure = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.number_of_retries = 60 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.retry_delay = 1 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.send_service_user_token = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.split_loggers = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.timeout = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.verify_ssl = True {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican.verify_ssl_path = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.auth_section = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.auth_type = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.cafile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.certfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.collect_timing = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.insecure = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.keyfile = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.split_loggers = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] barbican_service_user.timeout = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.approle_role_id = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.approle_secret_id = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.kv_mountpoint = secret {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.kv_path = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.kv_version = 2 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.namespace = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.root_token_id = **** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.ssl_ca_crt_file = None {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.timeout = 60.0 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.use_ssl = False {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:39 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] ******************************************************************************** {{(pid=83271) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 11:23:39 devstack quobyte-client[83395]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 11:23:39 devstack quobyte-client[83395]: Invalid parameters found, error: missing mount point. Apr 16 11:23:39 devstack quobyte-client[83395]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 11:23:39 devstack quobyte-client[83395]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:23:39 devstack cinder-volume[83394]: INFO cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 ... Apr 16 11:23:39 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d -c /etc/quobyte/client-cinder.cfg {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:39 devstack sudo[83396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d -c /etc/quobyte/client-cinder.cfg Apr 16 11:23:39 devstack sudo[83396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:40 devstack sudo[83396]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.515s {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:40 devstack cinder-volume[83394]: INFO cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 succeeded Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.522s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:40 devstack sudo[83465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:23:40 devstack sudo[83465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:40 devstack sudo[83465]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.395s {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:40 devstack cinder-volume[83394]: INFO cinder.volume.driver [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG cinder.volume.driver [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83394) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_db.sqlalchemy.engines [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83394) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG dbcounter [-] [83394] Writer thread running {{(pid=83394) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG cinder.db.sqlalchemy.api [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Building query based on filter {{(pid=83394) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG cinder.image.image_utils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83394) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 11:23:40 devstack cinder-volume[83394]: INFO cinder.keymgr.migration [None req-95081ec5-d62d-431b-abe3-0ec3797f8dd3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:23:40 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:40 devstack sudo[83468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:23:40 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:41 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.395s {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG cinder.manager [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Notifying Schedulers of capabilities ... {{(pid=83394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:23:41 devstack cinder-volume[83394]: INFO cinder.volume.manager [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Driver initialization completed successfully. Apr 16 11:23:41 devstack cinder-volume[83394]: INFO cinder.manager [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Initiating service 3 cleanup Apr 16 11:23:41 devstack cinder-volume[83394]: INFO cinder.manager [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Service 3 cleanup completed. Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG cinder.service [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Creating RPC server for service cinder-volume {{(pid=83394) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG cinder.service [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83394) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 11:23:41 devstack cinder-volume[83394]: INFO cinder.volume.manager [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:41 devstack sudo[83473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:23:41 devstack sudo[83473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:41 devstack sudo[83473]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:41 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.427s {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:41 devstack cinder-volume[83394]: INFO cinder.volume.manager [None req-fda968d5-00c7-49b5-b69e-e6e3b65c17a7 None None] Driver post RPC initialization completed successfully. Apr 16 11:23:44 devstack cinder-volume[74174]: DEBUG oslo_concurrency.lockutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Acquiring lock "singleton_lock" {{(pid=74174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 11:23:44 devstack cinder-volume[74174]: DEBUG oslo_concurrency.lockutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Acquired lock "singleton_lock" {{(pid=74174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 11:23:44 devstack cinder-volume[74174]: DEBUG oslo_concurrency.lockutils [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Releasing lock "singleton_lock" {{(pid=74174) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 11:23:44 devstack cinder-volume[74174]: WARNING amqp [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 11:23:44 devstack cinder-volume[74174]: WARNING amqp [None req-81b9f888-79e4-4158-8b30-853e500bd06f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 11:23:44 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:23:44 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:23:44 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83394) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:23:44 devstack cinder-volume[83394]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83394) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:23:44 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83394) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:23:44 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:44 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:23:44 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:45 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:45 devstack cinder-volume[83394]: DEBUG oslo_concurrency.processutils [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.421s {{(pid=83394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:45 devstack cinder-volume[83394]: DEBUG cinder.manager [None req-b7c4308d-10ab-4fd3-8d26-68d29480c286 None None] Notifying Schedulers of capabilities ... {{(pid=83394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:23:45 devstack cinder-volume[83271]: INFO oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Caught SIGTERM, stopping children Apr 16 11:23:45 devstack cinder-volume[83271]: DEBUG oslo_concurrency.lockutils [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Acquiring lock "singleton_lock" {{(pid=83271) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 11:23:45 devstack cinder-volume[83271]: DEBUG oslo_concurrency.lockutils [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Acquired lock "singleton_lock" {{(pid=83271) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 11:23:45 devstack cinder-volume[83271]: DEBUG oslo_concurrency.lockutils [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Releasing lock "singleton_lock" {{(pid=83271) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 11:23:45 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Stop services. {{(pid=83271) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 11:23:45 devstack cinder-volume[83271]: DEBUG oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Killing children. {{(pid=83271) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 11:23:45 devstack cinder-volume[83271]: INFO oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Waiting on 1 children to exit Apr 16 11:23:49 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Acquiring lock "singleton_lock" {{(pid=83394) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 11:23:49 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Acquired lock "singleton_lock" {{(pid=83394) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 11:23:49 devstack cinder-volume[83394]: DEBUG oslo_concurrency.lockutils [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Releasing lock "singleton_lock" {{(pid=83394) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 11:23:49 devstack cinder-volume[83394]: WARNING amqp [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 11:23:49 devstack cinder-volume[83394]: WARNING amqp [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 11:23:49 devstack cinder-volume[83271]: INFO oslo_service.backend._eventlet.service [None req-4dfa1459-fe41-4957-8632-dbf722fab0cf None None] Child 83394 exited with status 0 Apr 16 11:23:49 devstack cinder-volume[83629]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 11:23:49 devstack cinder-volume[83629]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 11:23:49 devstack cinder-volume[83629]: we strongly recommend against using it for new projects. Apr 16 11:23:49 devstack cinder-volume[83629]: If you are already using Eventlet, we recommend migrating to a different Apr 16 11:23:49 devstack cinder-volume[83629]: framework. For more detail see Apr 16 11:23:49 devstack cinder-volume[83629]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 11:23:49 devstack cinder-volume[83629]: import eventlet # noqa Apr 16 11:23:51 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83629) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 11:23:51 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83629) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 11:23:51 devstack cinder-volume[83629]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83629) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 11:23:51 devstack cinder-volume[83629]: INFO dbcounter [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Registered counter for database cinder Apr 16 11:23:51 devstack cinder-volume[83629]: DEBUG oslo_db.sqlalchemy.engines [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG dbcounter [-] [83629] Writer thread running {{(pid=83629) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 11:23:52 devstack cinder-volume[83629]: INFO cinder.rpc [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 11:23:52 devstack cinder-volume[83629]: INFO cinder.rpc [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_db.sqlalchemy.engines [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:52 devstack cinder-volume[83629]: INFO cinder.volume.manager [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Determined volume DB was empty at startup. Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG cinder.volume.manager [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83629) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 11:23:52 devstack cinder-volume[83629]: WARNING stevedore.named [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 11:23:52 devstack cinder-volume[83629]: WARNING castellan.key_manager [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 11:23:52 devstack cinder-volume[83629]: WARNING cinder.keymgr.conf_key_mgr [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 11:23:52 devstack cinder-volume[83629]: INFO cinder.volume.manager [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_db.sqlalchemy.engines [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:52 devstack cinder-volume[83629]: INFO oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Starting 1 workers Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Started child 83804 {{(pid=83629) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Full set of CONF: {{(pid=83629) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] ******************************************************************************** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Configuration options gathered from: {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] ================================================================================ {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 11:23:52 devstack cinder-volume[83804]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] allow_availability_zone_fallback = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] allow_compression_on_image_upload = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] allowed_direct_url_schemes = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] api_rate_limit = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] auth_strategy = keystone {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_availability_zone = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_host = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_stats_polling_interval = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backup_api_class = cinder.backup.api.API {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backup_name_template = backup-%s {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backup_use_same_host = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backup_use_temp_snapshot = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] chap_password = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] chap_username = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_internal_tenant_project_id = 225091130829427a8514b7b943b9717d {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_internal_tenant_user_id = 5a78e82ea96843cb9cab70f1aa11b43f {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cluster = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] compression_format = gzip {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] compute_api_class = cinder.compute.nova.API {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] config_dir = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] config_source = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] control_exchange = openstack {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] debug = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] default_availability_zone = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] default_group_type = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] default_volume_type = QuobyteHD {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] disk_geometry = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] driver_client_cert = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] driver_client_cert_key = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] driver_data_namespace = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] driver_ssl_cert_path = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] driver_ssl_cert_verify = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] driver_use_ssl = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] enable_new_services = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] enable_unsupported_driver = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] enabled_backends = ['QuobyteHD'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] enforce_multipath_for_image_xfer = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] filter_function = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_api_insecure = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_api_servers = ['http://192.168.122.3/image'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_api_ssl_compression = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_ca_certificates_file = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_catalog_info = image:glance:publicURL {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_num_retries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance_request_timeout = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] goodness_function = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] graceful_shutdown_timeout = 5 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] group_api_class = cinder.group.api.API {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] host = devstack {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_compress_on_upload = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_conversion_address_space_limit = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_conversion_cpu_limit = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83804) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_conversion_disable = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_upload_use_cinder_backend = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_upload_use_internal_tenant = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_volume_cache_enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_volume_cache_max_count = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] image_volume_cache_max_size_gb = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] init_host_max_objects_retrieval = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] instance_format = [instance: %(uuid)s] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] iscsi_target_flags = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] iscsi_write_cache = on {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] iser_helper = tgtadm {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] iser_ip_address = 192.168.122.3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] iser_port = 3260 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_color = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_config_append = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_dir = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_file = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_options = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_rotate_interval = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_rotate_interval_type = days {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] log_rotation_type = none {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] max_age = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] max_logfile_count = 30 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] max_logfile_size_mb = 200 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] max_over_subscription_ratio = 20.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] message_reap_interval = 86400 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] message_ttl = 2592000 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] migration_create_volume_timeout_secs = 300 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] monkey_patch = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] monkey_patch_modules = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] my_ip = 192.168.122.3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] no_snapshot_gb_quota = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] num_iser_scan_tries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] num_shell_tries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] num_volume_device_scan_tries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] nvmeof_conn_info_version = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] nvmet_ns_id = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] nvmet_port_id = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] osapi_max_limit = 1000 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] osapi_volume_ext_list = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] osapi_volume_listen = 0.0.0.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] osapi_volume_listen_port = 8776 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] osapi_volume_use_ssl = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] osapi_volume_workers = 2 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] per_volume_size_limit = -1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] periodic_fuzzy_delay = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] periodic_interval = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] project_id_regex = [0-9a-f\-]+ {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] public_endpoint = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] publish_errors = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] quota_backup_gigabytes = 1000 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] quota_backups = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] quota_gigabytes = 1000 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] quota_groups = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] quota_snapshots = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] quota_volumes = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] rate_limit_burst = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] rate_limit_except_level = CRITICAL {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] rate_limit_interval = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] reinit_driver_count = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] replication_device = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] report_discard_supported = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] report_interval = 120 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] reservation_clean_interval = 86400 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] reservation_expire = 86400 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] reserved_image_namespaces = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] reserved_percentage = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] rpc_response_timeout = 120 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] run_external_periodic_tasks = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] scst_target_driver = iscsi {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] scst_target_iqn_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_down_time = 720 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] shell_completion = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] snapshot_name_template = snapshot-%s {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] split_loggers = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] state_path = /opt/stack/data/cinder {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] storage_availability_zone = nova {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] storage_protocol = iSCSI {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] syslog_log_facility = LOG_USER {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] target_helper = lioadm {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] target_ip_address = 192.168.122.3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] target_port = 3260 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] target_protocol = iscsi {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] target_secondary_ip_addresses = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] trace_flags = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] transfer_api_class = cinder.transfer.api.API {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] transport_url = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] until_refresh = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] use_chap_auth = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] use_default_quota_class = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] use_journal = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] use_json = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] use_multipath_for_image_xfer = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] use_stderr = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] use_syslog = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] verify_glance_signatures = enabled {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_api_class = cinder.volume.api.API {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_backend_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_clear = zero {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_clear_ionice = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_clear_size = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_copy_bps_limit = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_dd_blocksize = 1M {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_name_template = volume-%s {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_service_inithost_offload = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volume_usage_audit_period = month {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] zoning_mode = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_concurrency.disable_process_locking = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.admin_password = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.admin_token = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.admin_user = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_admin_prefix = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_port = 35357 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_protocol = https {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_section = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_type = password {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_uri = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.auth_version = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.cache = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.delay_auth_decision = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.http_connect_timeout = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.identity_uri = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.include_service_catalog = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.insecure = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.interface = public {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_password = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcache_username = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.region_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.service_token_roles_required = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.service_type = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.token_cache_time = 300 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.3/identity {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.backend = dogpile.cache.null {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.backend_argument = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.backend_expiration_time = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.config_prefix = cache.oslo {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.debug_cache_backend = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.enable_retry_client = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.enable_socket_keepalive = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.enforce_fips_mode = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.expiration_time = 600 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.hashclient_retry_attempts = 2 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.memcache_dead_retry = 300 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.memcache_pool_maxsize = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.memcache_sasl_enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.password = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.proxies = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.redis_db = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.redis_sentinel_service_name = mymaster {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.redis_server = localhost:6379 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.retry_attempts = 2 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.retry_delay = 0.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.socket_keepalive_count = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83804) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.socket_keepalive_idle = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.socket_keepalive_interval = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.socket_timeout = 1.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.tls_allowed_ciphers = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.tls_cafile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.tls_certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.tls_enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.tls_keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cache.username = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] coordination.backend_url = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.asyncio_connection = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.asyncio_slave_connection = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.backend = sqlalchemy {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.connection = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.connection_debug = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.connection_parameters = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.connection_recycle_time = 3600 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.connection_trace = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.db_inc_retry_interval = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.db_max_retries = 20 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Running cmd (subprocess): mount.quobyte {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.db_max_retry_interval = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.db_retry_interval = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.max_overflow = 50 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.max_pool_size = 5 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.max_retries = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.mysql_wsrep_sync_wait = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.pool_timeout = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.retry_interval = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.slave_connection = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.sqlite_synchronous = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.synchronous_reader = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] database.use_db_reconnect = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.connection_string = messaging:// {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.es_doc_type = notification {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.es_scroll_size = 10000 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.es_scroll_time = 2m {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.filter_error_trace = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.hmac_keys = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.sentinel_service_name = mymaster {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.socket_timeout = 0.1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.trace_requests = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler.trace_sqlalchemy = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler_jaeger.process_tags = {} {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler_jaeger.service_name_prefix = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] profiler_otlp.service_name_prefix = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.enforce_new_defaults = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: WARNING oslo_config.cfg [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.enforce_scope = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.policy_default_rule = default {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.policy_file = policy.yaml {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_policy.remote_timeout = 60.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] privsep_osbrick.group = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] privsep_osbrick.helper_command = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] privsep_osbrick.user = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_sys_admin.group = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_sys_admin.helper_command = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] cinder_sys_admin.user = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.auth_section = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.auth_type = password {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.cafile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.collect_timing = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.insecure = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.send_service_user_token = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.split_loggers = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] service_user.timeout = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.auth_section = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.auth_type = password {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.collect_timing = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.insecure = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.region_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.split_loggers = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] glance.timeout = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.backend_availability_zone = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.chap_password = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.chap_username = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.disk_geometry = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.driver_client_cert = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.driver_client_cert_key = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.driver_data_namespace = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.driver_use_ssl = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.enable_unsupported_driver = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.extra_capabilities = {} {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.filter_function = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.goodness_function = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.iscsi_target_flags = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.iscsi_write_cache = on {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.iser_helper = tgtadm {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.iser_ip_address = 192.168.122.3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.iser_port = 3260 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_host = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_login = admin {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_mount_options = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_password = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_private_key = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_share_path = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_ssh_port = 22 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.num_shell_tries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.nvmet_port_id = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.quobyte_client_cfg = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack quobyte-client[83806]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.quobyte_volume_url = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.replication_device = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack quobyte-client[83806]: Invalid parameters found, error: missing mount point. Apr 16 11:23:52 devstack quobyte-client[83806]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 11:23:52 devstack quobyte-client[83806]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.report_discard_supported = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.reserved_percentage = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.scst_target_driver = iscsi {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.scst_target_iqn_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.storage_protocol = iSCSI {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.target_helper = tgtadm {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.target_ip_address = 192.168.122.3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.target_port = 3260 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.target_protocol = iscsi {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.trace_flags = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.unique_fqdn_network = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.use_chap_auth = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_backend_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_clear = zero {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_clear_ionice = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_clear_size = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_reports.file_event_handler = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_reports.log_dir = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.backend_availability_zone = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.backend_host = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.chap_password = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.chap_username = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.chiscsi_conf = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.disk_geometry = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.driver_client_cert = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.driver_client_cert_key = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.driver_data_namespace = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.driver_use_ssl = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.extra_capabilities = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.filter_function = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.goodness_function = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.iscsi_target_flags = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.iscsi_write_cache = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.iser_helper = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.iser_ip_address = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.iser_port = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.iser_target_prefix = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_host = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_login = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_mount_options = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_password = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_private_key = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_share_path = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_ssh_port = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.num_shell_tries = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nvmet_ns_id = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.nvmet_port_id = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.replication_device = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.report_discard_supported = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.reserved_percentage = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.scst_target_driver = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.storage_protocol = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack sudo[83822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.target_helper = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.target_ip_address = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.target_port = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack sudo[83822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.target_prefix = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.target_protocol = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.trace_flags = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.unique_fqdn_network = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.use_chap_auth = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_clear = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_clear_ionice = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_clear_size = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] QuobyteHD.volumes_dir = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.ssl = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.ssl_version = {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_notifications.driver = [] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_notifications.retry = -1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] oslo_messaging_notifications.transport_url = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] key_manager.fixed_key = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.barbican_api_version = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.barbican_endpoint = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.barbican_endpoint_type = public {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.barbican_region_name = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.cafile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.collect_timing = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.insecure = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.number_of_retries = 60 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.retry_delay = 1 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.send_service_user_token = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.split_loggers = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.timeout = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.verify_ssl = True {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican.verify_ssl_path = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.auth_section = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.auth_type = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.cafile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.certfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.collect_timing = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.insecure = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.keyfile = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.split_loggers = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] barbican_service_user.timeout = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.approle_role_id = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.approle_secret_id = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.kv_mountpoint = secret {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.kv_path = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.kv_version = 2 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.namespace = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.root_token_id = **** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.ssl_ca_crt_file = None {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.timeout = 60.0 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.use_ssl = False {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 11:23:52 devstack cinder-volume[83629]: DEBUG oslo_service.backend._eventlet.service [None req-02d4f5ac-108d-4780-8cb8-8b167488042d None None] ******************************************************************************** {{(pid=83629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 11:23:52 devstack sudo[83822]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.404s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:52 devstack cinder-volume[83804]: INFO cinder.volume.driver [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Driver hasn't implemented _init_vendor_properties() Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.volume.driver [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83804) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_db.sqlalchemy.engines [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writer thread running {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.db.sqlalchemy.api [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Building query based on filter {{(pid=83804) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83804) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:23:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:52 devstack cinder-volume[83804]: INFO cinder.keymgr.migration [None req-3701d307-2935-47e8-9b54-4c43e9f2ec65 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 11:23:52 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:23:52 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:53 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:23:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Driver initialization completed successfully. Apr 16 11:23:53 devstack cinder-volume[83804]: INFO cinder.manager [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Initiating service 3 cleanup Apr 16 11:23:53 devstack cinder-volume[83804]: INFO cinder.manager [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Service 3 cleanup completed. Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG cinder.service [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Creating RPC server for service cinder-volume {{(pid=83804) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG cinder.service [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83804) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 11:23:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:23:53 devstack sudo[83866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:23:53 devstack sudo[83866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:23:53 devstack sudo[83866]: pam_unix(sudo:session): session closed for user root Apr 16 11:23:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.393s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:23:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a98c1fea-4e7f-4045-a8b5-e55b9a9fbb6e None None] Driver post RPC initialization completed successfully. Apr 16 11:24:02 devstack cinder-volume[83629]: DEBUG dbcounter [-] [83629] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83629) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:24:03 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=1 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:24:03 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Flow 'volume_create_manager' (6867bbc6-050d-4c58-b275-3f19edc18d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504b6073-c102-4ca0-8d6c-f44430f0fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504b6073-c102-4ca0-8d6c-f44430f0fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1377670864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94346b7-080a-4293-97ba-13de260435d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76bd7dee4291498e8cbbf5bc1210871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:51Z,use_quota=True,user_id='0e996a77398c434b98b5878d25ca4bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a47b08e-faad-4876-a2d5-4e216555706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a47b08e-faad-4876-a2d5-4e216555706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4a69c9-e268-45bc-af03-77c2bd849486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4a69c9-e268-45bc-af03-77c2bd849486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94346b7-080a-4293-97ba-13de260435d1', 'volume_name': 'volume-c94346b7-080a-4293-97ba-13de260435d1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3ac2af-1b1c-43c9-9cdc-364e041ff636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3ac2af-1b1c-43c9-9cdc-364e041ff636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9663175f-f4a1-4600-b8dd-798f0997878b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Volume c94346b7-080a-4293-97ba-13de260435d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94346b7-080a-4293-97ba-13de260435d1', 'volume_size': 1} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1377670864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94346b7-080a-4293-97ba-13de260435d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76bd7dee4291498e8cbbf5bc1210871e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:51Z,use_quota=True,user_id='0e996a77398c434b98b5878d25ca4bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Creating volume c94346b7-080a-4293-97ba-13de260435d1 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:24:50 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:50 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 1073741824 Apr 16 11:24:50 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Flow 'volume_create_manager' (7d665fe0-9e6f-42e9-9514-3159fcbdfbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9361c92-6b56-45a2-bac3-28b4975078ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9361c92-6b56-45a2-bac3-28b4975078ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2040270458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7841e693-a1e0-4277-b282-1a39d037285d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69480794e7264cf8ab6f773e327cae3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:51Z,use_quota=True,user_id='9a1eac12d47549809e17e7255787a0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df6c701-1609-4d48-8c8d-a84fb26b7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df6c701-1609-4d48-8c8d-a84fb26b7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cab8a5-9d56-44c1-8f8f-1ba33533b1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cab8a5-9d56-44c1-8f8f-1ba33533b1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7841e693-a1e0-4277-b282-1a39d037285d', 'volume_name': 'volume-7841e693-a1e0-4277-b282-1a39d037285d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7027d1c2-932e-4d42-9cc9-7c9ed12d87f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7027d1c2-932e-4d42-9cc9-7c9ed12d87f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304c1a75-c21e-4826-ac82-5af0ceea40fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Volume 7841e693-a1e0-4277-b282-1a39d037285d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7841e693-a1e0-4277-b282-1a39d037285d', 'volume_size': 1} Apr 16 11:24:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:51 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 1073741824" returned: 0 in 0.900s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:51 devstack sudo[84565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 Apr 16 11:24:51 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:52 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1" returned: 0 in 0.578s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2040270458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7841e693-a1e0-4277-b282-1a39d037285d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69480794e7264cf8ab6f773e327cae3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:51Z,use_quota=True,user_id='9a1eac12d47549809e17e7255787a0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Creating volume 7841e693-a1e0-4277-b282-1a39d037285d {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:24:52 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9663175f-f4a1-4600-b8dd-798f0997878b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94346b7-080a-4293-97ba-13de260435d1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff42e8f4-1e5b-4267-bd6c-9d60fd0f2ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:52 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d 1073741824 Apr 16 11:24:52 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Volume volume-c94346b7-080a-4293-97ba-13de260435d1 (c94346b7-080a-4293-97ba-13de260435d1): created successfully Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff42e8f4-1e5b-4267-bd6c-9d60fd0f2ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Flow 'volume_create_manager' (6867bbc6-050d-4c58-b275-3f19edc18d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f3aa9c95-f27f-44dd-8da9-ad470d595085 tempest-VolumesAdminNegativeTest-541111583 None] Created volume successfully. Apr 16 11:24:53 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d 1073741824" returned: 0 in 0.780s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:53 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d Apr 16 11:24:53 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Acquiring lock "cinder-c94346b7-080a-4293-97ba-13de260435d1-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Lock "cinder-c94346b7-080a-4293-97ba-13de260435d1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Acquiring lock "cinder-quobyte-c94346b7-080a-4293-97ba-13de260435d1" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Lock "cinder-quobyte-c94346b7-080a-4293-97ba-13de260435d1" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:24:53 devstack cinder-volume[83804]: INFO oslo.privsep.daemon [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjngv_jku/privsep.sock'] Apr 16 11:24:53 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjngv_jku/privsep.sock Apr 16 11:24:53 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:53 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d" returned: 0 in 0.524s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304c1a75-c21e-4826-ac82-5af0ceea40fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7841e693-a1e0-4277-b282-1a39d037285d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a404f8-6d48-4067-bf01-dc0616dd310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:53 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Volume volume-7841e693-a1e0-4277-b282-1a39d037285d (7841e693-a1e0-4277-b282-1a39d037285d): created successfully Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a404f8-6d48-4067-bf01-dc0616dd310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Flow 'volume_create_manager' (7d665fe0-9e6f-42e9-9514-3159fcbdfbc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0228c06e-6a0b-4db9-94f7-8b4c7d7f435c tempest-VolumesTestJSON-1024522024 None] Created volume successfully. Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 11:24:53 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 11:24:54 devstack cinder-volume[83804]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 16 11:24:54 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:54 devstack cinder-volume[83804]: INFO oslo.privsep.daemon [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Spawned new privsep daemon via rootwrap Apr 16 11:24:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Accepted privsep connection to /tmp/tmpjngv_jku/privsep.sock {{(pid=83804) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 16 11:24:54 devstack cinder-volume[83804]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 16 11:24:54 devstack cinder-volume[83804]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 16 11:24:54 devstack cinder-volume[83804]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 16 11:24:54 devstack cinder-volume[83804]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84608 Apr 16 11:24:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bc7560-3a99-47b3-b721-509bb9c9a10f]: (2,) {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:24:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba683fab-e797-4952-9ed9-a8e5a9254990]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:24:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:54 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 Apr 16 11:24:54 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Flow 'volume_create_manager' (fc005230-fe76-4ed3-94a7-2a2c34419063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b71183-352a-4c19-9d78-5a8afbc1d754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:55 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b71183-352a-4c19-9d78-5a8afbc1d754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1377527373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084086ba-52fe-438e-ac0f-69a760e4bbdf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69480794e7264cf8ab6f773e327cae3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:55Z,use_quota=True,user_id='9a1eac12d47549809e17e7255787a0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86469015-b3cc-43ee-9a15-945342a56e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86469015-b3cc-43ee-9a15-945342a56e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1965b5e-b667-462f-ad6e-22876a2a7bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1965b5e-b667-462f-ad6e-22876a2a7bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084086ba-52fe-438e-ac0f-69a760e4bbdf', 'volume_name': 'volume-084086ba-52fe-438e-ac0f-69a760e4bbdf', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ff24f2-f375-433a-a583-0d6634ec62ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ff24f2-f375-433a-a583-0d6634ec62ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f8d2dd-3cf0-4649-8ed7-40fdd4067dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:55 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Volume 084086ba-52fe-438e-ac0f-69a760e4bbdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084086ba-52fe-438e-ac0f-69a760e4bbdf', 'volume_size': 1} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1377527373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084086ba-52fe-438e-ac0f-69a760e4bbdf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69480794e7264cf8ab6f773e327cae3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:55Z,use_quota=True,user_id='9a1eac12d47549809e17e7255787a0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Creating volume 084086ba-52fe-438e-ac0f-69a760e4bbdf {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:24:55 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1" returned: 0 in 0.665s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:55 devstack sudo[84617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf 1073741824 Apr 16 11:24:55 devstack sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:55 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1 Apr 16 11:24:55 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:55 devstack sudo[84617]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf 1073741824" returned: 0 in 0.528s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:55 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c94346b7-080a-4293-97ba-13de260435d1" returned: 0 in 0.535s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Lock "cinder-quobyte-c94346b7-080a-4293-97ba-13de260435d1" released by "delete_volume" :: held 2.360s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:55 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf Apr 16 11:24:55 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:55 devstack cinder-volume[83804]: WARNING cinder.quota [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:24:55 devstack cinder-volume[83804]: WARNING cinder.quota [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Created reservations ['468288c7-2faf-4549-83bc-068b5b10d178', '5f5ffd0f-f535-4297-9f50-17a843d5fcf6', 'a30dcce1-94ac-44c1-9754-8f9a0b27d329', '36f33950-f5e8-4229-ad4e-18f16a000b0c'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:55 devstack sudo[84631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:24:55 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:56 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f8d2dd-3cf0-4649-8ed7-40fdd4067dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084086ba-52fe-438e-ac0f-69a760e4bbdf', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5979f0b5-07ee-43ff-a55f-77fe4dfa12e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:56 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Volume volume-084086ba-52fe-438e-ac0f-69a760e4bbdf (084086ba-52fe-438e-ac0f-69a760e4bbdf): created successfully Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5979f0b5-07ee-43ff-a55f-77fe4dfa12e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Flow 'volume_create_manager' (fc005230-fe76-4ed3-94a7-2a2c34419063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c47725bd-fbfc-4d53-b4b6-833b6627d96a tempest-VolumesTestJSON-1024522024 None] Created volume successfully. Apr 16 11:24:56 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.514s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:24:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Deleted volume successfully. Apr 16 11:24:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea57cd7e-5439-479a-88ba-76718956e136 tempest-VolumesAdminNegativeTest-541111583 None] Lock "cinder-c94346b7-080a-4293-97ba-13de260435d1-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Flow 'volume_create_manager' (8dd93cc0-3a0d-48ff-86fb-e4e87d47a63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8b527f-34d0-4185-a763-91bd1acd76f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8b527f-34d0-4185-a763-91bd1acd76f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1374951917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f1ba8b-7b09-4f71-89b0-c1bad4052f36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69480794e7264cf8ab6f773e327cae3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:58Z,use_quota=True,user_id='9a1eac12d47549809e17e7255787a0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42faac13-9972-4ebb-92e4-6bef16324aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42faac13-9972-4ebb-92e4-6bef16324aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37645aa-9020-42df-803a-ab2df3b3715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37645aa-9020-42df-803a-ab2df3b3715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f1ba8b-7b09-4f71-89b0-c1bad4052f36', 'volume_name': 'volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312924e8-2d36-44af-a0db-b7960bc37571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312924e8-2d36-44af-a0db-b7960bc37571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca5ecb2-e01a-4bc7-9e34-df8ba7141a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:57 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Volume b3f1ba8b-7b09-4f71-89b0-c1bad4052f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36', 'volume_size': 1} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1374951917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f1ba8b-7b09-4f71-89b0-c1bad4052f36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69480794e7264cf8ab6f773e327cae3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:58Z,use_quota=True,user_id='9a1eac12d47549809e17e7255787a0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Creating volume b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:24:57 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:24:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:57 devstack sudo[84654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 1073741824 Apr 16 11:24:57 devstack sudo[84654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:58 devstack sudo[84654]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 1073741824" returned: 0 in 0.853s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:58 devstack sudo[84681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 Apr 16 11:24:58 devstack sudo[84681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Flow 'volume_create_manager' (3b7b6bd6-14a2-4008-95bc-0b3251c71e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481ee011-542d-49a7-b113-bafcf7764986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481ee011-542d-49a7-b113-bafcf7764986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1048132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5f3b7c-952b-4ff5-a025-ba3f3baf9ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d04318ef9142ed821d0b4ec350a5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:59Z,use_quota=True,user_id='525685067e994a6aa2cba767102f7314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dda83f-2b1b-44da-8227-f41d9eb3abd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dda83f-2b1b-44da-8227-f41d9eb3abd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff0e3b-0e14-4c98-94ae-a054f3bda3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff0e3b-0e14-4c98-94ae-a054f3bda3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5f3b7c-952b-4ff5-a025-ba3f3baf9ace', 'volume_name': 'volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d3fe53-688a-4ba1-be04-5f9022656629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d3fe53-688a-4ba1-be04-5f9022656629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6a580-da4f-4995-9f04-7c8183a33b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:59 devstack sudo[84681]: pam_unix(sudo:session): session closed for user root Apr 16 11:24:59 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Volume be5f3b7c-952b-4ff5-a025-ba3f3baf9ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace', 'volume_size': 1} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36" returned: 0 in 0.831s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1048132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5f3b7c-952b-4ff5-a025-ba3f3baf9ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d04318ef9142ed821d0b4ec350a5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:24:59Z,use_quota=True,user_id='525685067e994a6aa2cba767102f7314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Creating volume be5f3b7c-952b-4ff5-a025-ba3f3baf9ace {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:24:59 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:24:59 devstack sudo[84686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace 1073741824 Apr 16 11:24:59 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca5ecb2-e01a-4bc7-9e34-df8ba7141a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0740aa34-2a09-4ce5-a0d0-b6b9ccdccd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:24:59 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Volume volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 (b3f1ba8b-7b09-4f71-89b0-c1bad4052f36): created successfully Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0740aa34-2a09-4ce5-a0d0-b6b9ccdccd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:24:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Flow 'volume_create_manager' (8dd93cc0-3a0d-48ff-86fb-e4e87d47a63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:24:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-3d4eeb13-25a0-4125-a07d-a8ebf546c987 tempest-VolumesTestJSON-1024522024 None] Created volume successfully. Apr 16 11:25:00 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace 1073741824" returned: 0 in 0.901s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:00 devstack sudo[84699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace Apr 16 11:25:00 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Acquiring lock "cinder-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Lock "cinder-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:01 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Acquiring lock "cinder-quobyte-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace" returned: 0 in 0.775s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Lock "cinder-quobyte-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36" acquired by "delete_volume" :: waited 0.043s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc6a580-da4f-4995-9f04-7c8183a33b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0043a1ca-c010-4774-bb54-e16b654f502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[54138386-39c9-4700-9367-6ebf5d25f4c4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:01 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Volume volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace (be5f3b7c-952b-4ff5-a025-ba3f3baf9ace): created successfully Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0043a1ca-c010-4774-bb54-e16b654f502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Flow 'volume_create_manager' (3b7b6bd6-14a2-4008-95bc-0b3251c71e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:01 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2abb1fa9-8f3c-4d91-8049-68b3e1b92010 tempest-DeleteServersTestJSON-206824813 None] Created volume successfully. Apr 16 11:25:01 devstack sudo[84711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 Apr 16 11:25:01 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:02 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36" returned: 0 in 0.539s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:02 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36 Apr 16 11:25:02 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:02 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Lock "cinder-quobyte-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36" released by "delete_volume" :: held 1.039s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Created reservations ['6dc8bb0c-df90-41fe-907e-d69a5febcff8', 'fab9c8ef-53ab-4457-b704-6a8fff3b7c73', 'a3785bb6-eb2b-46d6-acb1-ad9e609694c6', 'd781a938-2731-44fd-a6f0-787a7376c240'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:02 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:02 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:03 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.569s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Deleted volume successfully. Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-932be707-e1a5-4f7d-b38a-60b19ae91326 tempest-VolumesTestJSON-1024522024 None] Lock "cinder-b3f1ba8b-7b09-4f71-89b0-c1bad4052f36-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Acquiring lock "cinder-084086ba-52fe-438e-ac0f-69a760e4bbdf-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Lock "cinder-084086ba-52fe-438e-ac0f-69a760e4bbdf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Acquiring lock "cinder-quobyte-084086ba-52fe-438e-ac0f-69a760e4bbdf" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Lock "cinder-quobyte-084086ba-52fe-438e-ac0f-69a760e4bbdf" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286bee2-c95e-44d4-b24a-b25eb98b9a2d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:03 devstack sudo[84731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf Apr 16 11:25:03 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:04 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf" returned: 0 in 0.624s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:04 devstack sudo[84739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf Apr 16 11:25:04 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:04 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-084086ba-52fe-438e-ac0f-69a760e4bbdf" returned: 0 in 0.504s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Lock "cinder-quobyte-084086ba-52fe-438e-ac0f-69a760e4bbdf" released by "delete_volume" :: held 1.148s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Created reservations ['7d04e938-b7b6-4b5a-bb5f-9eb042e33051', '9b9b501f-3dd8-4199-9962-98397a439999', 'be112f27-73e3-4e83-87c4-af3b070daff3', '9163c73d-2ba8-460a-9d91-986682eccfd1'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:04 devstack sudo[84743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:04 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:05 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.676s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:05 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:05 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Deleted volume successfully. Apr 16 11:25:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a23c9252-30bb-424d-988e-ad80575da2be tempest-VolumesTestJSON-1024522024 None] Lock "cinder-084086ba-52fe-438e-ac0f-69a760e4bbdf-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Acquiring lock "cinder-7841e693-a1e0-4277-b282-1a39d037285d-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Lock "cinder-7841e693-a1e0-4277-b282-1a39d037285d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Acquiring lock "cinder-quobyte-7841e693-a1e0-4277-b282-1a39d037285d" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Lock "cinder-quobyte-7841e693-a1e0-4277-b282-1a39d037285d" acquired by "delete_volume" :: waited 0.031s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:06 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ced17-763a-4a31-89ea-bf42ba24c92c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:06 devstack sudo[84912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d Apr 16 11:25:06 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:07 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d" returned: 0 in 1.048s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:07 devstack sudo[84925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d Apr 16 11:25:07 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:07 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7841e693-a1e0-4277-b282-1a39d037285d" returned: 0 in 0.605s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Lock "cinder-quobyte-7841e693-a1e0-4277-b282-1a39d037285d" released by "delete_volume" :: held 1.693s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Created reservations ['ac8b37a8-1c8d-4780-a40d-8c87180498bd', 'fe1f4f0a-e44c-4ac7-aecc-5556487d5a46', 'a78cf204-af08-413a-a983-b88521dbe9a2', 'c8fe1d32-dfe0-4285-aed5-3f0d50be601a'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:07 devstack sudo[84929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:07 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:08 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.013s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:08 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Deleted volume successfully. Apr 16 11:25:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2dcbf85-62f2-4d39-8808-836baa8e14af tempest-VolumesTestJSON-1024522024 None] Lock "cinder-7841e693-a1e0-4277-b282-1a39d037285d-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:09 devstack cinder-volume[83804]: WARNING py.warnings [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 16 11:25:09 devstack cinder-volume[83804]: .first() Apr 16 11:25:09 devstack cinder-volume[83804]: Apr 16 11:25:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa4ea3-771b-4a3a-a7c0-e2412ca72350]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:09 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace Apr 16 11:25:09 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:10 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace" returned: 0 in 1.009s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.039s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253', 'name': 'volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ccc25d5-bcf4-416a-a3b6-18d75040c4e9', 'enforce_multipath': True} {{(pid=83804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 11:25:10 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-bac5b7e5-6fff-4838-a34a-a6eec5892723 req-9b810360-6495-437d-b6b8-037ff0486f0a tempest-DeleteServersTestJSON-206824813 None] attachment_update completed successfully. Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:10 devstack sudo[85028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:10 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:11 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.947s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:13 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-625c725e-39b8-40a9-bd3f-97a1b0ec2da4 tempest-GroupsTest-1097580956 None] Group tempest-Group1-1798954404: creating Apr 16 11:25:13 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-625c725e-39b8-40a9-bd3f-97a1b0ec2da4 tempest-GroupsTest-1097580956 None] Group tempest-Group1-1798954404: created successfully Apr 16 11:25:13 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-625c725e-39b8-40a9-bd3f-97a1b0ec2da4 tempest-GroupsTest-1097580956 None] Create group completed successfully. Apr 16 11:25:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e76551d7-20e2-422e-9483-844f748e5771 tempest-GroupsTest-1097580956 None] Group tempest-Group2-365833048: creating Apr 16 11:25:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e76551d7-20e2-422e-9483-844f748e5771 tempest-GroupsTest-1097580956 None] Group tempest-Group2-365833048: created successfully Apr 16 11:25:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e76551d7-20e2-422e-9483-844f748e5771 tempest-GroupsTest-1097580956 None] Create group completed successfully. Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Flow 'volume_create_manager' (4d8c5915-f988-45d0-9c3a-958afca8186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa61fb6-40b5-4db6-ab08-1a17141573fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa61fb6-40b5-4db6-ab08-1a17141573fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1470991717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a53cdf6-7fcb-45e3-8993-5d0355cea622,host='devstack@QuobyteHD#QuobyteHD',id=fed806c3-1867-4584-b75f-6854c737ca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba4d3b501c347f59641f2b58cb487f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:16Z,use_quota=True,user_id='dfd82b56697f4186950260e0cc4e0e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bad793d-d91b-42ed-8090-cecedb07ef7d),volume_type_id=5bad793d-d91b-42ed-8090-cecedb07ef7d)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2464a3c-b120-4bd9-badf-fec9a414a36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2464a3c-b120-4bd9-badf-fec9a414a36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d88bf91-b4ef-459e-83c6-8923c4285630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d88bf91-b4ef-459e-83c6-8923c4285630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed806c3-1867-4584-b75f-6854c737ca42', 'volume_name': 'volume-fed806c3-1867-4584-b75f-6854c737ca42', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2027dc3b-efcc-43ad-a6da-90c8847dcbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2027dc3b-efcc-43ad-a6da-90c8847dcbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfe1c6e-79f7-486d-ba8c-358d436c28dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:16 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Volume fed806c3-1867-4584-b75f-6854c737ca42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed806c3-1867-4584-b75f-6854c737ca42', 'volume_size': 1} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a53cdf6-7fcb-45e3-8993-5d0355cea622,created_at=2026-04-16T09:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1470991717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a53cdf6-7fcb-45e3-8993-5d0355cea622,host='devstack@QuobyteHD#QuobyteHD',id=fed806c3-1867-4584-b75f-6854c737ca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba4d3b501c347f59641f2b58cb487f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:16Z,use_quota=True,user_id='dfd82b56697f4186950260e0cc4e0e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bad793d-d91b-42ed-8090-cecedb07ef7d),volume_type_id=5bad793d-d91b-42ed-8090-cecedb07ef7d)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Creating volume fed806c3-1867-4584-b75f-6854c737ca42 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:25:16 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:25:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:16 devstack sudo[85493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 1073741824 Apr 16 11:25:16 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:17 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 1073741824" returned: 0 in 1.011s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:17 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 Apr 16 11:25:17 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:18 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42" returned: 0 in 0.512s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfe1c6e-79f7-486d-ba8c-358d436c28dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed806c3-1867-4584-b75f-6854c737ca42', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8187114-ce95-4294-b2a3-53b724e3f8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:18 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Volume volume-fed806c3-1867-4584-b75f-6854c737ca42 (fed806c3-1867-4584-b75f-6854c737ca42): created successfully Apr 16 11:25:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8187114-ce95-4294-b2a3-53b724e3f8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Flow 'volume_create_manager' (4d8c5915-f988-45d0-9c3a-958afca8186e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-df103007-0097-48ad-b529-20334ec32f8f tempest-GroupsTest-1097580956 None] Created volume successfully. Apr 16 11:25:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Acquiring lock "cinder-quobyte-fed806c3-1867-4584-b75f-6854c737ca42" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Lock "cinder-quobyte-fed806c3-1867-4584-b75f-6854c737ca42" acquired by "delete_volume" :: waited 0.031s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:19 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d91b5-07f3-4d27-ac90-23a69edcbf56]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:19 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 Apr 16 11:25:19 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:19 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-65102c83-5bf7-4695-821a-df472042a1fb req-9b8ac8b2-9df0-40d4-9234-439e2af003f7 tempest-DeleteServersTestJSON-206824813 None] Terminate volume connection completed successfully. Apr 16 11:25:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-65102c83-5bf7-4695-821a-df472042a1fb req-9b8ac8b2-9df0-40d4-9234-439e2af003f7 tempest-DeleteServersTestJSON-206824813 None] Deleting attachment 4ccc25d5-bcf4-416a-a3b6-18d75040c4e9. {{(pid=83804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 11:25:20 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42" returned: 0 in 0.691s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:20 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42 Apr 16 11:25:20 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:20 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fed806c3-1867-4584-b75f-6854c737ca42" returned: 0 in 0.547s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Lock "cinder-quobyte-fed806c3-1867-4584-b75f-6854c737ca42" released by "delete_volume" :: held 1.270s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Created reservations ['854bb48a-9a70-4a4b-af11-d7153e4d66de'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:20 devstack cinder-volume[83804]: WARNING cinder.quota [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-12502424 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-12502424, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:25:20 devstack cinder-volume[83804]: WARNING cinder.quota [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-12502424 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-12502424, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Created reservations ['fffa9271-6ec5-433d-839e-d32c90045570', '63ba068d-1a09-4081-9414-a9dac234d711', '1a8187f4-2c7c-4e2a-a748-23e62c11263a', '45cb5d1c-a987-49ec-a5aa-fee9f26fbf82'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:20 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:20 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Flow 'volume_create_manager' (51e223e6-baa9-4b39-9990-bc87f0ebe3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c55255-87d9-481b-97fd-5b0b715e679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c55255-87d9-481b-97fd-5b0b715e679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-821515857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108c97fb-1131-453c-955a-72c682cd64c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9135a2b6d4dd4fc2a08dd8ee66c0a8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:21Z,use_quota=True,user_id='83c1680152c945c490081e4e85f0446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298e4b7e-3732-4d43-83fa-3830097e1ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298e4b7e-3732-4d43-83fa-3830097e1ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415dd35f-7a34-4f10-aa7b-ef657e65db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415dd35f-7a34-4f10-aa7b-ef657e65db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108c97fb-1131-453c-955a-72c682cd64c1', 'volume_name': 'volume-108c97fb-1131-453c-955a-72c682cd64c1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2d78f6-d472-4701-98b6-808dc77df6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2d78f6-d472-4701-98b6-808dc77df6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943fb6d4-1468-4b5e-a333-451609633f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:21 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Volume 108c97fb-1131-453c-955a-72c682cd64c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108c97fb-1131-453c-955a-72c682cd64c1', 'volume_size': 1} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-821515857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108c97fb-1131-453c-955a-72c682cd64c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9135a2b6d4dd4fc2a08dd8ee66c0a8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:21Z,use_quota=True,user_id='83c1680152c945c490081e4e85f0446d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Creating volume 108c97fb-1131-453c-955a-72c682cd64c1 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:25:21 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:21 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 1073741824 Apr 16 11:25:21 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:21 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.560s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:21 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6f97b919-3ce5-4594-8778-3875d477bbef tempest-GroupsTest-1097580956 None] Delete group completed successfully. Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Created reservations ['3b67778f-02ee-44dd-9530-eafbf6509f4c'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:21 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:21 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:21 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 1073741824" returned: 0 in 0.579s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:21 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 Apr 16 11:25:21 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:22 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:22 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-be945a35-56d7-4547-976a-30deb9b9b59a tempest-GroupsTest-1097580956 None] Delete group completed successfully. Apr 16 11:25:22 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943fb6d4-1468-4b5e-a333-451609633f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108c97fb-1131-453c-955a-72c682cd64c1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f829aa-6580-40a1-92b2-75db8433e02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:22 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Volume volume-108c97fb-1131-453c-955a-72c682cd64c1 (108c97fb-1131-453c-955a-72c682cd64c1): created successfully Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f829aa-6580-40a1-92b2-75db8433e02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Flow 'volume_create_manager' (51e223e6-baa9-4b39-9990-bc87f0ebe3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:22 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-5d1d5ce1-c069-492d-888c-cdd12f9a3191 req-df2b6a62-bf9e-40e4-a017-173692804fd6 tempest-VolumesGetTestJSON-1484914520 None] Created volume successfully. Apr 16 11:25:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f8df21ba-4d6a-4de6-9546-3a8831bc0e09 tempest-GroupsTest-1097580956 None] Group tempest-GroupsTest-Group-823726901: creating Apr 16 11:25:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f8df21ba-4d6a-4de6-9546-3a8831bc0e09 tempest-GroupsTest-1097580956 None] Group tempest-GroupsTest-Group-823726901: created successfully Apr 16 11:25:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f8df21ba-4d6a-4de6-9546-3a8831bc0e09 tempest-GroupsTest-1097580956 None] Create group completed successfully. Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Acquiring lock "cinder-108c97fb-1131-453c-955a-72c682cd64c1-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Lock "cinder-108c97fb-1131-453c-955a-72c682cd64c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Acquiring lock "cinder-quobyte-108c97fb-1131-453c-955a-72c682cd64c1" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Lock "cinder-quobyte-108c97fb-1131-453c-955a-72c682cd64c1" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0730c5af-580c-4a0d-aa5a-a5c184dfe7b8]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Acquiring lock "cinder-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Lock "cinder-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:23 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 Apr 16 11:25:23 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Acquiring lock "cinder-quobyte-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Lock "cinder-quobyte-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[73109446-7f78-467c-aa20-62992c02d47f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:23 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace Apr 16 11:25:23 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:23 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1" returned: 0 in 0.577s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:23 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1 Apr 16 11:25:23 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:24 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace" returned: 0 in 0.508s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:24 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace Apr 16 11:25:24 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:24 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Lock "cinder-quobyte-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace" released by "delete_volume" :: held 1.012s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:24 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-108c97fb-1131-453c-955a-72c682cd64c1" returned: 0 in 0.618s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Lock "cinder-quobyte-108c97fb-1131-453c-955a-72c682cd64c1" released by "delete_volume" :: held 1.236s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Flow 'volume_create_manager' (ab9d0781-3c0f-4041-978e-f08dd07abad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bac1e2f-5dc8-49f2-9ce9-7ae11155833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bac1e2f-5dc8-49f2-9ce9-7ae11155833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660935947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e229acb2-9c29-46d1-9ec8-65f1aeb973da,host='devstack@QuobyteHD#QuobyteHD',id=9ed3f414-f923-4d89-87e2-cedce2f21534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba4d3b501c347f59641f2b58cb487f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:25Z,use_quota=True,user_id='dfd82b56697f4186950260e0cc4e0e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d42f906-39f8-44ee-8e11-0948283e209c),volume_type_id=3d42f906-39f8-44ee-8e11-0948283e209c)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37444d16-72cd-4ae7-b53c-a3ef07778287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37444d16-72cd-4ae7-b53c-a3ef07778287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad834135-684b-49c1-bda4-10e5755c1811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad834135-684b-49c1-bda4-10e5755c1811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed3f414-f923-4d89-87e2-cedce2f21534', 'volume_name': 'volume-9ed3f414-f923-4d89-87e2-cedce2f21534', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b72ded-9c55-47f3-ab5b-aa6f8fd6df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b72ded-9c55-47f3-ab5b-aa6f8fd6df3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbcd148-689b-4d74-a55b-e15214402054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:24 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Volume 9ed3f414-f923-4d89-87e2-cedce2f21534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed3f414-f923-4d89-87e2-cedce2f21534', 'volume_size': 1} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e229acb2-9c29-46d1-9ec8-65f1aeb973da,created_at=2026-04-16T09:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660935947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e229acb2-9c29-46d1-9ec8-65f1aeb973da,host='devstack@QuobyteHD#QuobyteHD',id=9ed3f414-f923-4d89-87e2-cedce2f21534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba4d3b501c347f59641f2b58cb487f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:25Z,use_quota=True,user_id='dfd82b56697f4186950260e0cc4e0e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d42f906-39f8-44ee-8e11-0948283e209c),volume_type_id=3d42f906-39f8-44ee-8e11-0948283e209c)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Creating volume 9ed3f414-f923-4d89-87e2-cedce2f21534 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:25:24 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:24 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 1073741824 Apr 16 11:25:24 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Created reservations ['25e71c5a-4914-4fca-91ca-c5318337b3ae', '6b969e7b-0a09-4a24-bd4c-ab01d70034ff', 'a66512fb-99a7-4b1b-a5d8-0d024c614270', '6934c87c-23ff-4717-86c9-32d751cafbf7'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.quota [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Created reservations ['47afb4a7-46fc-42af-b61c-1ab51beac6ce', 'bea29dab-e961-496b-9854-7791c1399b30', 'd2fa2b32-5450-4324-8938-0c10dbbb8059', '74f73855-ac74-47a2-bdb9-c298a787ecd8'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:24 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:24 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:24 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:24 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:25 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 1073741824" returned: 0 in 0.740s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:25 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 Apr 16 11:25:25 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:25 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.705s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:25 devstack cinder-volume[83804]: DEBUG cinder.manager [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:25 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Deleted volume successfully. Apr 16 11:25:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-be1909f1-8ffa-473f-9d54-431cbd88380b req-cb9cb47c-028f-411c-b7c3-b36091f9030e tempest-VolumesGetTestJSON-1484914520 None] Lock "cinder-108c97fb-1131-453c-955a-72c682cd64c1-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:26 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.233s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:26 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Deleted volume successfully. Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ffea5192-7382-4e38-98d2-db547e0dec20 tempest-DeleteServersTestJSON-206824813 None] Lock "cinder-be5f3b7c-952b-4ff5-a025-ba3f3baf9ace-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:26 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534" returned: 0 in 0.998s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbcd148-689b-4d74-a55b-e15214402054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed3f414-f923-4d89-87e2-cedce2f21534', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b31f1f-4ee3-4ebd-8e9e-8ebdd91d3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:26 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Volume volume-9ed3f414-f923-4d89-87e2-cedce2f21534 (9ed3f414-f923-4d89-87e2-cedce2f21534): created successfully Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b31f1f-4ee3-4ebd-8e9e-8ebdd91d3faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Flow 'volume_create_manager' (ab9d0781-3c0f-4041-978e-f08dd07abad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:26 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-85f8b230-f129-48d2-b676-367dd8a9500b tempest-GroupsTest-1097580956 None] Created volume successfully. Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Flow 'volume_create_manager' (5beb4900-3309-4b28-af69-c1705056db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dec6fd-9143-496a-adac-82a746b13d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dec6fd-9143-496a-adac-82a746b13d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:26Z,deleted=False,deleted_at=None,display_description='',display_name='034fc4ef-8c4a-42fa-8d52-09b5d951d135-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64806e93-d066-4f4e-8626-e271a69a189f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04746a7f58c54123a1f3dcb4a66c8335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:27Z,use_quota=True,user_id='341c7895793647b889cf15821e8d6e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1a9f76-bff4-4962-87c8-51a10ea02302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1a9f76-bff4-4962-87c8-51a10ea02302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bc8192-f444-4d8b-bc7e-88dbda247b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bc8192-f444-4d8b-bc7e-88dbda247b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64806e93-d066-4f4e-8626-e271a69a189f', 'volume_name': 'volume-64806e93-d066-4f4e-8626-e271a69a189f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881f568d-f3ea-429b-9c91-b74d6c60f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881f568d-f3ea-429b-9c91-b74d6c60f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5c0ca2-fb65-491a-a2c9-780c7dd0aa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:26 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Volume 64806e93-d066-4f4e-8626-e271a69a189f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64806e93-d066-4f4e-8626-e271a69a189f', 'volume_size': 1} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:26Z,deleted=False,deleted_at=None,display_description='',display_name='034fc4ef-8c4a-42fa-8d52-09b5d951d135-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64806e93-d066-4f4e-8626-e271a69a189f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04746a7f58c54123a1f3dcb4a66c8335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:27Z,use_quota=True,user_id='341c7895793647b889cf15821e8d6e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Creating volume 64806e93-d066-4f4e-8626-e271a69a189f {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:25:26 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:25:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:26 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f 1073741824 Apr 16 11:25:26 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:27 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f 1073741824" returned: 0 in 0.622s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:27 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f Apr 16 11:25:27 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:28 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f" returned: 0 in 0.713s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5c0ca2-fb65-491a-a2c9-780c7dd0aa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64806e93-d066-4f4e-8626-e271a69a189f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c97856-5ef9-4669-bdeb-62da845ef717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:28 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Volume volume-64806e93-d066-4f4e-8626-e271a69a189f (64806e93-d066-4f4e-8626-e271a69a189f): created successfully Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c97856-5ef9-4669-bdeb-62da845ef717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Flow 'volume_create_manager' (5beb4900-3309-4b28-af69-c1705056db29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:28 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-e09ea874-795f-4a43-8502-031d0d4d6888 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Created volume successfully. Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Flow 'volume_create_manager' (afa883cf-c182-410d-bf88-7a7fcc3fa8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740bbe7e-c213-4e51-95ad-6497c5cf1e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740bbe7e-c213-4e51-95ad-6497c5cf1e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284040266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e229acb2-9c29-46d1-9ec8-65f1aeb973da,host='devstack@QuobyteHD#QuobyteHD',id=42c880cb-0464-4791-9f1a-ca294854392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba4d3b501c347f59641f2b58cb487f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:28Z,use_quota=True,user_id='dfd82b56697f4186950260e0cc4e0e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d42f906-39f8-44ee-8e11-0948283e209c),volume_type_id=3d42f906-39f8-44ee-8e11-0948283e209c)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eea3747-2931-4b24-928f-411b39bb1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eea3747-2931-4b24-928f-411b39bb1f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bceed108-dc4a-4683-9193-07644c103572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bceed108-dc4a-4683-9193-07644c103572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c880cb-0464-4791-9f1a-ca294854392b', 'volume_name': 'volume-42c880cb-0464-4791-9f1a-ca294854392b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76087ead-dcae-44b0-84ed-7a050330ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76087ead-dcae-44b0-84ed-7a050330ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1bb17d-3cee-4f9c-ab83-bca6122e6fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:28 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Volume 42c880cb-0464-4791-9f1a-ca294854392b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c880cb-0464-4791-9f1a-ca294854392b', 'volume_size': 1} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e229acb2-9c29-46d1-9ec8-65f1aeb973da,created_at=2026-04-16T09:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-284040266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e229acb2-9c29-46d1-9ec8-65f1aeb973da,host='devstack@QuobyteHD#QuobyteHD',id=42c880cb-0464-4791-9f1a-ca294854392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba4d3b501c347f59641f2b58cb487f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:28Z,use_quota=True,user_id='dfd82b56697f4186950260e0cc4e0e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d42f906-39f8-44ee-8e11-0948283e209c),volume_type_id=3d42f906-39f8-44ee-8e11-0948283e209c)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Creating volume 42c880cb-0464-4791-9f1a-ca294854392b {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:25:28 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:25:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:28 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b 1073741824 Apr 16 11:25:28 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:29 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b 1073741824" returned: 0 in 0.649s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:29 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b Apr 16 11:25:29 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:29 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b" returned: 0 in 0.799s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1bb17d-3cee-4f9c-ab83-bca6122e6fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c880cb-0464-4791-9f1a-ca294854392b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39715d6-b406-435a-9351-f9e5d89484c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:29 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Volume volume-42c880cb-0464-4791-9f1a-ca294854392b (42c880cb-0464-4791-9f1a-ca294854392b): created successfully Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39715d6-b406-435a-9351-f9e5d89484c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Flow 'volume_create_manager' (afa883cf-c182-410d-bf88-7a7fcc3fa8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:29 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dcc56e1f-4696-412d-b560-b6e2856598f3 tempest-GroupsTest-1097580956 None] Created volume successfully. Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-fcc73f97-dfc9-4ad9-85bf-99bb9bd92ea1 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-fcc73f97-dfc9-4ad9-85bf-99bb9bd92ea1 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e1b333-4ab7-4cf8-a18c-2e5e2a69b4d6]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-fcc73f97-dfc9-4ad9-85bf-99bb9bd92ea1 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:30 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f Apr 16 11:25:30 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:30 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c861dc0-e686-4fb5-a8a0-4d9e6c68c7c3 tempest-BackendsCapabilitiesAdminTestsJSON-1293423461 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83804) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-fcc73f97-dfc9-4ad9-85bf-99bb9bd92ea1 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f" returned: 0 in 0.614s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-fcc73f97-dfc9-4ad9-85bf-99bb9bd92ea1 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.625s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-fcc73f97-dfc9-4ad9-85bf-99bb9bd92ea1 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253', 'name': 'volume-64806e93-d066-4f4e-8626-e271a69a189f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99617d10-6259-4964-9477-7bfe7620022f', 'enforce_multipath': True} {{(pid=83804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 11:25:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-ec761eb1-e683-4f01-8932-fb40593d8a00 req-fcc73f97-dfc9-4ad9-85bf-99bb9bd92ea1 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] attachment_update completed successfully. Apr 16 11:25:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a3dc9541-e4af-435c-9bac-918fb84bcd69 tempest-BackendsCapabilitiesAdminTestsJSON-1293423461 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83804) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 11:25:31 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-39802bbe-e2c5-4ae6-a484-b6352c7dd380 tempest-GroupsTest-1097580956 None] Update group completed successfully. Apr 16 11:25:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-cb4f9776-8758-49c2-9aad-41b444639c57 tempest-GroupsTest-1097580956 None] Update group completed successfully. Apr 16 11:25:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Acquiring lock "cinder-quobyte-42c880cb-0464-4791-9f1a-ca294854392b" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Lock "cinder-quobyte-42c880cb-0464-4791-9f1a-ca294854392b" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:34 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7491ad-e5db-4bc8-b4e1-66997826a65b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:34 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b Apr 16 11:25:34 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:34 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b" returned: 0 in 0.726s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:34 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b Apr 16 11:25:34 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8416a864-3d12-4924-82be-93bb60e2f35d tempest-GroupSnapshotsV319Test-933737099 None] Group tempest-GroupSnapshotsV319Test-Group-1794165160: creating Apr 16 11:25:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8416a864-3d12-4924-82be-93bb60e2f35d tempest-GroupSnapshotsV319Test-933737099 None] Group tempest-GroupSnapshotsV319Test-Group-1794165160: created successfully Apr 16 11:25:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8416a864-3d12-4924-82be-93bb60e2f35d tempest-GroupSnapshotsV319Test-933737099 None] Create group completed successfully. Apr 16 11:25:35 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-42c880cb-0464-4791-9f1a-ca294854392b" returned: 0 in 0.580s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Lock "cinder-quobyte-42c880cb-0464-4791-9f1a-ca294854392b" released by "delete_volume" :: held 1.345s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Acquiring lock "cinder-quobyte-9ed3f414-f923-4d89-87e2-cedce2f21534" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Lock "cinder-quobyte-9ed3f414-f923-4d89-87e2-cedce2f21534" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4188830b-f1ac-4c23-8335-c90cc517d127]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:35 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 Apr 16 11:25:35 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:36 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534" returned: 0 in 0.976s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:36 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534 Apr 16 11:25:36 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Flow 'volume_create_manager' (068302f4-5276-4493-adac-c983da55998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9ec0a7-be21-4777-97ea-3a1e9ec72e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9ec0a7-be21-4777-97ea-3a1e9ec72e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465404126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=892c18fa-1f2c-4787-809f-ee1ccdb3c254,host='devstack@QuobyteHD#QuobyteHD',id=911787a6-a23e-42c8-9a9f-b5ea9edb4088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d9d1f0aaa54b4580a675bedc7e71e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:37Z,use_quota=True,user_id='398ed1e30a1c4e2baad7d10eda4cb247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e8f79d1-bdae-46a6-aaff-3b5956206681),volume_type_id=7e8f79d1-bdae-46a6-aaff-3b5956206681)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6027c4a-0cec-4242-94ab-0225c23d0806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6027c4a-0cec-4242-94ab-0225c23d0806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3a7dbf-69aa-44d4-b496-af573d2e6e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3a7dbf-69aa-44d4-b496-af573d2e6e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911787a6-a23e-42c8-9a9f-b5ea9edb4088', 'volume_name': 'volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:37 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e6bb2c-6c2d-4e9d-ab90-6100201e4dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e6bb2c-6c2d-4e9d-ab90-6100201e4dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c29a69-e39a-491f-ba0a-a9d183de1237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:37 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Volume 911787a6-a23e-42c8-9a9f-b5ea9edb4088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088', 'volume_size': 1} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=892c18fa-1f2c-4787-809f-ee1ccdb3c254,created_at=2026-04-16T09:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465404126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=892c18fa-1f2c-4787-809f-ee1ccdb3c254,host='devstack@QuobyteHD#QuobyteHD',id=911787a6-a23e-42c8-9a9f-b5ea9edb4088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d9d1f0aaa54b4580a675bedc7e71e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:37Z,use_quota=True,user_id='398ed1e30a1c4e2baad7d10eda4cb247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e8f79d1-bdae-46a6-aaff-3b5956206681),volume_type_id=7e8f79d1-bdae-46a6-aaff-3b5956206681)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Creating volume 911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:25:37 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ed3f414-f923-4d89-87e2-cedce2f21534" returned: 0 in 0.952s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Lock "cinder-quobyte-9ed3f414-f923-4d89-87e2-cedce2f21534" released by "delete_volume" :: held 2.003s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:37 devstack sudo[86094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 1073741824 Apr 16 11:25:37 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Created reservations ['2b19b711-6eba-45d5-92f7-2fa05a983378'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:37 devstack cinder-volume[83804]: WARNING cinder.quota [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1618605216 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1618605216, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:25:37 devstack cinder-volume[83804]: WARNING cinder.quota [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1618605216 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1618605216, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Created reservations ['3ef82702-566e-4469-ba3f-3e90f3601270', '27f29b34-a910-45d5-b495-4fc1def1a305', 'f23f75b4-7b8a-44cf-82d3-21ece1cce8b6', '5c033cb2-faf8-41b9-9142-614445c85fc8'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Created reservations ['ca7ce040-eed0-46fe-8e5a-a3eebe90ec59', '0008b042-630d-4109-904b-3c96b89c4c84', '13a1fa21-536b-45ce-9855-4f500c0ece61', '3edc37e5-1f2b-4b7f-9463-650e8e0c4cf1'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:37 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:37 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:38 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.648s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:38 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:38 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a4e9df45-e659-436d-ac7b-1cbf9a763869 tempest-GroupsTest-1097580956 None] Delete group completed successfully. Apr 16 11:25:38 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 1073741824" returned: 0 in 1.092s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:38 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 Apr 16 11:25:38 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:39 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088" returned: 0 in 0.500s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c29a69-e39a-491f-ba0a-a9d183de1237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61384da4-2707-4081-a1f1-d4ec8d75863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:39 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Volume volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 (911787a6-a23e-42c8-9a9f-b5ea9edb4088): created successfully Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61384da4-2707-4081-a1f1-d4ec8d75863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Flow 'volume_create_manager' (068302f4-5276-4493-adac-c983da55998c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:39 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d23e817e-2b97-4735-a8c1-0e5e506c1b19 tempest-GroupSnapshotsV319Test-933737099 None] Created volume successfully. Apr 16 11:25:39 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] GroupSnapshot 01dab988-a3a0-46b8-9358-bcadad6406d9: creating. Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Group snapshot 01dab988-a3a0-46b8-9358-bcadad6406d9: creating. {{(pid=83804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Creating offline snapshot d982da9f-2e74-4cb3-af79-2f231e2e622a of volume 911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7876ff-b757-42b7-ad3b-ee949f32d54d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:39 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 Apr 16 11:25:39 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:40 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088" returned: 0 in 0.967s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:40 devstack sudo[86118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a 1G Apr 16 11:25:40 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:41 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a 1G" returned: 0 in 0.694s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:41 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a Apr 16 11:25:41 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:42 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a" returned: 0 in 0.556s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:42 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:25:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:42 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a Apr 16 11:25:42 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:42 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:42 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.info Apr 16 11:25:42 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:43 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.info" returned: 0 in 0.585s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:43 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:25:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:43 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.info Apr 16 11:25:43 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:43 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=101,cinder:UPDATE=136,cinder:INSERT=20,cinder:DELETE=4 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:25:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f97f06b2-7fac-4f3c-9c28-e76a0ef5687c tempest-GroupsV314Test-1765002614 None] Group tempest-GroupsV314Test-Group-1047279017: creating Apr 16 11:25:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f97f06b2-7fac-4f3c-9c28-e76a0ef5687c tempest-GroupsV314Test-1765002614 None] Group tempest-GroupsV314Test-Group-1047279017: created successfully Apr 16 11:25:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f97f06b2-7fac-4f3c-9c28-e76a0ef5687c tempest-GroupsV314Test-1765002614 None] Create group completed successfully. Apr 16 11:25:43 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.info" returned: 0 in 0.587s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.990s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:43 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=112,cinder:UPDATE=110,cinder:INSERT=31,cinder:DELETE=13 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:25:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-15ade2ae-1c7b-4644-8ac7-757dfa0f588f tempest-GroupSnapshotsV319Test-933737099 None] group_snapshot 01dab988-a3a0-46b8-9358-bcadad6406d9: created successfully Apr 16 11:25:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] group_snapshot 01dab988-a3a0-46b8-9358-bcadad6406d9: deleting Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] group_snapshot 01dab988-a3a0-46b8-9358-bcadad6406d9: deleting {{(pid=83804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Acquiring lock "cinder-quobyte-911787a6-a23e-42c8-9a9f-b5ea9edb4088" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Lock "cinder-quobyte-911787a6-a23e-42c8-9a9f-b5ea9edb4088" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Acquiring lock "cinder-quobyte-d982da9f-2e74-4cb3-af79-2f231e2e622a" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Lock "cinder-quobyte-d982da9f-2e74-4cb3-af79-2f231e2e622a" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Deleting offline snapshot d982da9f-2e74-4cb3-af79-2f231e2e622a of volume 911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] snapshot_file for this snap is: volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[818898fc-126d-4eda-8480-4e81e08b10f8]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:44 devstack sudo[86170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a Apr 16 11:25:44 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Flow 'volume_create_manager' (6862c143-bb95-4e69-ae27-c6766da3144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac0f89d-3d5d-4dca-943a-e475f56e2149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac0f89d-3d5d-4dca-943a-e475f56e2149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366187558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dae6ffe7-e6d2-46c0-9bb4-44e7e1bcd652,host='devstack@QuobyteHD#QuobyteHD',id=c08e0087-03cc-49cc-bb83-2a7ab17ff71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e2bef44b772410b8480cd2ff3af056f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:45Z,use_quota=True,user_id='6197503226a04b7ba8b0ea19bca2db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8de7cb0a-1aa2-4405-80a6-2fb421ee84b3),volume_type_id=8de7cb0a-1aa2-4405-80a6-2fb421ee84b3)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988c6a9d-bafe-4771-970b-eca973b98698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988c6a9d-bafe-4771-970b-eca973b98698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42072afe-b4d2-4fc6-a78c-9228771f9d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42072afe-b4d2-4fc6-a78c-9228771f9d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08e0087-03cc-49cc-bb83-2a7ab17ff71d', 'volume_name': 'volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fa0d89-adf0-4514-8007-70c0a00b3513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fa0d89-adf0-4514-8007-70c0a00b3513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c369228-d9d4-43eb-9a06-87d00c7bab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:44 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Volume c08e0087-03cc-49cc-bb83-2a7ab17ff71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d', 'volume_size': 1} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dae6ffe7-e6d2-46c0-9bb4-44e7e1bcd652,created_at=2026-04-16T09:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-366187558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dae6ffe7-e6d2-46c0-9bb4-44e7e1bcd652,host='devstack@QuobyteHD#QuobyteHD',id=c08e0087-03cc-49cc-bb83-2a7ab17ff71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e2bef44b772410b8480cd2ff3af056f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:25:45Z,use_quota=True,user_id='6197503226a04b7ba8b0ea19bca2db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8de7cb0a-1aa2-4405-80a6-2fb421ee84b3),volume_type_id=8de7cb0a-1aa2-4405-80a6-2fb421ee84b3)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Creating volume c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:25:44 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:25:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:44 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d 1073741824 Apr 16 11:25:44 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:45 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a" returned: 0 in 0.624s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe9945-0e6b-4755-8433-98fdf0efb570]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:45 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 Apr 16 11:25:45 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:45 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d 1073741824" returned: 0 in 0.551s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:45 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d Apr 16 11:25:45 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:45 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088" returned: 0 in 0.499s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:45 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a Apr 16 11:25:45 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:45 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" returned: 0 in 0.547s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c369228-d9d4-43eb-9a06-87d00c7bab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7774500a-c2c1-48c0-8206-41cd39484a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:25:46 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Volume volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d (c08e0087-03cc-49cc-bb83-2a7ab17ff71d): created successfully Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7774500a-c2c1-48c0-8206-41cd39484a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Flow 'volume_create_manager' (6862c143-bb95-4e69-ae27-c6766da3144d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:25:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8387cf43-8a8e-47d1-bddd-9bc3f9861e75 tempest-GroupsV314Test-1765002614 None] Created volume successfully. Apr 16 11:25:46 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a" returned: 0 in 0.582s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:46 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a Apr 16 11:25:46 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:46 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088.d982da9f-2e74-4cb3-af79-2f231e2e622a" returned: 0 in 0.460s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Lock "cinder-quobyte-d982da9f-2e74-4cb3-af79-2f231e2e622a" released by "_delete_snapshot" :: held 2.231s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Lock "cinder-quobyte-911787a6-a23e-42c8-9a9f-b5ea9edb4088" released by "delete_snapshot" :: held 2.242s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:46 devstack cinder-volume[83804]: WARNING cinder.quota [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-681258244 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-681258244, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:25:46 devstack cinder-volume[83804]: WARNING cinder.quota [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-681258244 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-681258244, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:25:46 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] Created reservations ['17bc2b3e-ae71-4385-a3d9-f71af4df3e82', '65181f82-8224-4862-aad8-e701b36736f2', '4a57afa1-0188-401d-99b4-93a5c045e827', 'ae95c218-2238-44cc-a22a-8539283fc440'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8c288e92-aab6-4f92-abb5-d45d20adc555 tempest-GroupSnapshotsV319Test-933737099 None] group_snapshot 01dab988-a3a0-46b8-9358-bcadad6406d9: deleted successfully Apr 16 11:25:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Acquiring lock "cinder-quobyte-911787a6-a23e-42c8-9a9f-b5ea9edb4088" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Lock "cinder-quobyte-911787a6-a23e-42c8-9a9f-b5ea9edb4088" acquired by "delete_volume" :: waited 0.021s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:47 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b081a95a-b23d-4935-850c-64f8d8e30cf5]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:48 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Cloning volume c08e0087-03cc-49cc-bb83-2a7ab17ff71d to volume 542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 Apr 16 11:25:48 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 Apr 16 11:25:48 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Creating offline snapshot 5699e4cb-6545-484d-b8e4-858a2510c399 of volume c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff10660-029b-4f42-b6d3-59086c5974a5]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:48 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d Apr 16 11:25:48 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:48 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088" returned: 0 in 0.953s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:48 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088 Apr 16 11:25:48 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:48 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" returned: 0 in 0.754s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:49 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 1G Apr 16 11:25:49 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:49 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-911787a6-a23e-42c8-9a9f-b5ea9edb4088" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Lock "cinder-quobyte-911787a6-a23e-42c8-9a9f-b5ea9edb4088" released by "delete_volume" :: held 1.514s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Created reservations ['804e8953-8829-4719-8bca-998db6969951'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:49 devstack cinder-volume[83804]: WARNING cinder.quota [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-681258244 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-681258244, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Created reservations ['05b0d9a3-5618-4ec3-ac6d-1a73470dacc7', '21f5aeef-ae8d-4832-bace-585e6099533d', '9c373cba-1f6e-46dc-8cad-ea59286136bd', 'be2a15d4-1704-47f3-99a4-043c0d4f1909'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:49 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:25:49 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:49 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 1G" returned: 0 in 0.637s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:49 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 Apr 16 11:25:49 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:50 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.616s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:50 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:25:50 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-31608c15-4202-4566-bbda-c0c8a415c20a tempest-GroupSnapshotsV319Test-933737099 None] Delete group completed successfully. Apr 16 11:25:50 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399" returned: 0 in 0.548s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:50 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:25:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:50 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 Apr 16 11:25:50 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:50 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399" returned: 0 in 0.773s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:51 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.info Apr 16 11:25:51 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:51 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.info" returned: 0 in 0.822s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:51 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:25:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:51 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.info Apr 16 11:25:51 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:52 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.info" returned: 0 in 0.654s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Acquiring lock "cinder-quobyte-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] snapshot: 5699e4cb-6545-484d-b8e4-858a2510c399, volume: 542fb8ac-4119-4ad9-9c5b-5fab2c17fb51, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[167f9efe-ead3-4836-aa0b-d35c8296f275]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:52 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 Apr 16 11:25:52 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:53 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399" returned: 0 in 0.721s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:25:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:25:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:25:53 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55db7fb-3af7-4d1e-81d0-30e3707cc374]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:53 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d Apr 16 11:25:53 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:54 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" returned: 0 in 1.140s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:54 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:25:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:54 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 Apr 16 11:25:54 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:25:59 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 16 11:25:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" returned: 0 in 5.224s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:25:59 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f551630f-c792-48db-ba3e-7aab58b05cdf]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:25:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:25:59 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d Apr 16 11:25:59 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:00 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=22,cinder:SELECT=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:26:01 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" returned: 0 in 1.795s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:26:01 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Converted 1024.00 MB image at 195.96 MB/s Apr 16 11:26:01 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:01 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 Apr 16 11:26:01 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:01 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" returned: 0 in 0.426s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" released by "_copy_volume_from_snapshot" :: held 9.393s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Acquiring lock "cinder-quobyte-5699e4cb-6545-484d-b8e4-858a2510c399" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-5699e4cb-6545-484d-b8e4-858a2510c399" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Deleting offline snapshot 5699e4cb-6545-484d-b8e4-858a2510c399 of volume c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] snapshot_file for this snap is: volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff4cd37-f1e8-4676-8517-411ce4966e2c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:02 devstack sudo[86526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 Apr 16 11:26:02 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:02 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399" returned: 0 in 0.908s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:26:02 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[960cf658-4e3f-4697-b635-c4e7da612c6e]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:03 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d Apr 16 11:26:03 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:03 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=23,cinder:SELECT=32,cinder:INSERT=8 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:26:03 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" returned: 0 in 0.997s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:03 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 Apr 16 11:26:03 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:04 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399" returned: 0 in 1.016s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:04 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399 Apr 16 11:26:04 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:05 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d.5699e4cb-6545-484d-b8e4-858a2510c399" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-5699e4cb-6545-484d-b8e4-858a2510c399" released by "_delete_snapshot" :: held 3.575s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.469s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:05 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b0b02254-6ef2-4d9a-b43b-8d0b2cac9750 tempest-GroupsV314Test-1765002614 None] Create group from source-group-dae6ffe7-e6d2-46c0-9bb4-44e7e1bcd652 completed successfully. Apr 16 11:26:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Acquiring lock "cinder-quobyte-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:06 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3db3f1-7a0b-47e2-88d7-42761590b938]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:06 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 Apr 16 11:26:06 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:07 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" returned: 0 in 0.677s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:07 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51 Apr 16 11:26:07 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:07 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" returned: 0 in 0.579s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-542fb8ac-4119-4ad9-9c5b-5fab2c17fb51" released by "delete_volume" :: held 1.335s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Created reservations ['cc94ef1b-d7d1-49c2-b58c-b5f4b6908bc2'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:07 devstack cinder-volume[83804]: WARNING cinder.quota [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1669306028 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1669306028, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:26:07 devstack cinder-volume[83804]: WARNING cinder.quota [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1669306028 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1669306028, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Created reservations ['a253aad3-2d58-4ae4-bd47-fc9f94d7e5f6', '52d5972c-a366-4e33-a904-64606fc5f09c', '61a7c1d7-c155-4194-b165-095e375457c2', 'ba55d3cc-9cbd-41d0-859e-964e06f1630a'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:07 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:07 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:08 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:08 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f2244dad-211e-4ccf-b3f2-c5a64202aac9 tempest-GroupsV314Test-1765002614 None] Delete group completed successfully. Apr 16 11:26:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Acquiring lock "cinder-quobyte-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:08 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e6bc3-5e7d-49ee-9434-55d2a0d89304]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:09 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d Apr 16 11:26:09 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:09 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" returned: 0 in 0.846s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:09 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d Apr 16 11:26:09 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:10 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" returned: 0 in 0.678s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Lock "cinder-quobyte-c08e0087-03cc-49cc-bb83-2a7ab17ff71d" released by "delete_volume" :: held 1.561s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Created reservations ['88f32e05-93da-4722-9bc6-9f5092bab72a'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Created reservations ['7ab4959a-576a-4ed9-819f-1e09954137d9', '0539f3c7-b3be-4c96-ab86-4e7f500193b6', '1622874a-0fcc-4b5a-a419-dd582d8c9d5f', '33a8dd72-f891-490b-a7fe-3d73bec43b1f'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:10 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:10 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:10 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:10 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:11 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.812s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:11 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ff239802-23b7-4857-aee8-491ed5a2cf9f tempest-GroupsV314Test-1765002614 None] Delete group completed successfully. Apr 16 11:26:12 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.504s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:12 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Flow 'volume_create_manager' (716f2803-8cb4-4d4c-8c28-e9efc102b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0c63a7-8161-4297-a4b4-c74271d59659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0c63a7-8161-4297-a4b4-c74271d59659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-474997215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638b8b68-843b-46cb-a503-dcc45786f76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a6498495bb403890cb637d05bc314b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:14Z,use_quota=True,user_id='dc4d4a15fb9045b89fe9eafa6cddb70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9c6635-ea03-4351-8339-feec7930952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9c6635-ea03-4351-8339-feec7930952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff93a5-bb6b-47c2-84ac-64021f838396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ff93a5-bb6b-47c2-84ac-64021f838396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '638b8b68-843b-46cb-a503-dcc45786f76e', 'volume_name': 'volume-638b8b68-843b-46cb-a503-dcc45786f76e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d66a1-ed3b-4cca-abfd-b927492fa695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d66a1-ed3b-4cca-abfd-b927492fa695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5795732d-d473-4e2d-b35f-1d8dc3e3c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:14 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Volume 638b8b68-843b-46cb-a503-dcc45786f76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-638b8b68-843b-46cb-a503-dcc45786f76e', 'volume_size': 1} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-474997215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638b8b68-843b-46cb-a503-dcc45786f76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a6498495bb403890cb637d05bc314b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:14Z,use_quota=True,user_id='dc4d4a15fb9045b89fe9eafa6cddb70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Creating volume 638b8b68-843b-46cb-a503-dcc45786f76e {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:14 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:14 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e 1073741824 Apr 16 11:26:14 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:15 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e 1073741824" returned: 0 in 1.389s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:16 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e Apr 16 11:26:16 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:16 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e" returned: 0 in 0.711s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5795732d-d473-4e2d-b35f-1d8dc3e3c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-638b8b68-843b-46cb-a503-dcc45786f76e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa64a158-96fc-4b77-b7f1-be0fed35e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:16 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Volume volume-638b8b68-843b-46cb-a503-dcc45786f76e (638b8b68-843b-46cb-a503-dcc45786f76e): created successfully Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa64a158-96fc-4b77-b7f1-be0fed35e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Flow 'volume_create_manager' (716f2803-8cb4-4d4c-8c28-e9efc102b489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2db3bebd-88cd-429d-b565-d087ba2ad215 tempest-ServerRescueNegativeTestJSON-1776745641 None] Created volume successfully. Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Flow 'volume_create_manager' (38d29291-8059-4375-982a-087c484b0c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb8ca99-da54-427f-8b57-c35c954c093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb8ca99-da54-427f-8b57-c35c954c093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-242026389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f589edd5-9ef4-44a2-99b9-0497a5e309b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d6ffecd04441dba32ccb73e6d634e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:21Z,use_quota=True,user_id='21035f9cd7814a9ca5059d1964cb8576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7a0ee2-10df-474e-9ed7-cbf2e48515a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7a0ee2-10df-474e-9ed7-cbf2e48515a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0dd76d-d10d-4fee-9044-7e80e5a9e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0dd76d-d10d-4fee-9044-7e80e5a9e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f589edd5-9ef4-44a2-99b9-0497a5e309b5', 'volume_name': 'volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c073704-8ebe-4f0a-98f1-ee0170d3fa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c073704-8ebe-4f0a-98f1-ee0170d3fa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa1a252-b307-4783-8160-c4658678c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:20 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Volume f589edd5-9ef4-44a2-99b9-0497a5e309b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5', 'volume_size': 1} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-242026389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f589edd5-9ef4-44a2-99b9-0497a5e309b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d6ffecd04441dba32ccb73e6d634e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:21Z,use_quota=True,user_id='21035f9cd7814a9ca5059d1964cb8576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Creating volume f589edd5-9ef4-44a2-99b9-0497a5e309b5 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:21 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:21 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 1073741824 Apr 16 11:26:21 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:22 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 1073741824" returned: 0 in 1.363s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:22 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 Apr 16 11:26:22 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:23 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5" returned: 0 in 0.794s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa1a252-b307-4783-8160-c4658678c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0cca6e-7a2c-4d56-aa09-422906a2710c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:23 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Volume volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 (f589edd5-9ef4-44a2-99b9-0497a5e309b5): created successfully Apr 16 11:26:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0cca6e-7a2c-4d56-aa09-422906a2710c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Flow 'volume_create_manager' (38d29291-8059-4375-982a-087c484b0c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-96e8996e-eb13-4c53-86a9-7a9723d57b8b tempest-VolumesListAdminTestJSON-514830597 None] Created volume successfully. Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Flow 'volume_create_manager' (33a7b913-927a-4e61-adf3-9d2018901f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef209399-7fd2-4961-bd92-96e88d43af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef209399-7fd2-4961-bd92-96e88d43af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2120964712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826160ef-46b9-456a-ac56-bd7f9f989b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d6ffecd04441dba32ccb73e6d634e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:24Z,use_quota=True,user_id='21035f9cd7814a9ca5059d1964cb8576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdd95bb-7963-43dc-bc1a-e8c8c3f4da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdd95bb-7963-43dc-bc1a-e8c8c3f4da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3a0444-6c49-4790-acaf-e539629bb5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3a0444-6c49-4790-acaf-e539629bb5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826160ef-46b9-456a-ac56-bd7f9f989b96', 'volume_name': 'volume-826160ef-46b9-456a-ac56-bd7f9f989b96', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cf44d2-4d3d-4425-bcab-c3a4b1f65671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cf44d2-4d3d-4425-bcab-c3a4b1f65671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff10125e-3967-4005-8ff3-1d0864cbeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:24 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Volume 826160ef-46b9-456a-ac56-bd7f9f989b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826160ef-46b9-456a-ac56-bd7f9f989b96', 'volume_size': 1} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2120964712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826160ef-46b9-456a-ac56-bd7f9f989b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d6ffecd04441dba32ccb73e6d634e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:24Z,use_quota=True,user_id='21035f9cd7814a9ca5059d1964cb8576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Creating volume 826160ef-46b9-456a-ac56-bd7f9f989b96 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:24 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:24 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 1073741824 Apr 16 11:26:24 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:25 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 1073741824" returned: 0 in 1.036s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:25 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 Apr 16 11:26:25 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:26 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96" returned: 0 in 0.793s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff10125e-3967-4005-8ff3-1d0864cbeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826160ef-46b9-456a-ac56-bd7f9f989b96', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41905841-0d79-4375-ad3c-4839195e9f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:26 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Volume volume-826160ef-46b9-456a-ac56-bd7f9f989b96 (826160ef-46b9-456a-ac56-bd7f9f989b96): created successfully Apr 16 11:26:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41905841-0d79-4375-ad3c-4839195e9f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Flow 'volume_create_manager' (33a7b913-927a-4e61-adf3-9d2018901f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:26 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-966d4bbf-a7a7-4b55-9981-483b7c96c5c5 tempest-VolumesListAdminTestJSON-514830597 None] Created volume successfully. Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Flow 'volume_create_manager' (3dc94e9e-d61c-4a04-9a74-d7e83f8f5bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5363693a-66a3-4ebc-a510-df0298320cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5363693a-66a3-4ebc-a510-df0298320cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-815089102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e0a113-8b9e-4834-95e9-43756b38673e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d6ffecd04441dba32ccb73e6d634e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:27Z,use_quota=True,user_id='21035f9cd7814a9ca5059d1964cb8576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0674942a-58a4-4a5e-9309-15cd1877ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0674942a-58a4-4a5e-9309-15cd1877ab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60aac878-d1e9-46cc-8f42-5435d1d7cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60aac878-d1e9-46cc-8f42-5435d1d7cec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e0a113-8b9e-4834-95e9-43756b38673e', 'volume_name': 'volume-68e0a113-8b9e-4834-95e9-43756b38673e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c74c7e-7e08-4881-ba49-6df5a2ab0772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c74c7e-7e08-4881-ba49-6df5a2ab0772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90933a6-667e-4cd7-8f2c-d8366ffde6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:27 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Volume 68e0a113-8b9e-4834-95e9-43756b38673e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e0a113-8b9e-4834-95e9-43756b38673e', 'volume_size': 1} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-815089102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e0a113-8b9e-4834-95e9-43756b38673e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d6ffecd04441dba32ccb73e6d634e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:27Z,use_quota=True,user_id='21035f9cd7814a9ca5059d1964cb8576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Creating volume 68e0a113-8b9e-4834-95e9-43756b38673e {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:27 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:27 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e 1073741824 Apr 16 11:26:27 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:28 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e 1073741824" returned: 0 in 1.081s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:28 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e Apr 16 11:26:28 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:29 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e" returned: 0 in 1.093s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90933a6-667e-4cd7-8f2c-d8366ffde6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e0a113-8b9e-4834-95e9-43756b38673e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e18df95-d3b6-4620-afcb-d57d01dd12d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:29 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Volume volume-68e0a113-8b9e-4834-95e9-43756b38673e (68e0a113-8b9e-4834-95e9-43756b38673e): created successfully Apr 16 11:26:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e18df95-d3b6-4620-afcb-d57d01dd12d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Flow 'volume_create_manager' (3dc94e9e-d61c-4a04-9a74-d7e83f8f5bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:29 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a5091718-1f69-4393-afac-74a2430996f8 tempest-VolumesListAdminTestJSON-514830597 None] Created volume successfully. Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Flow 'volume_create_manager' (7df6d45f-e627-4f0e-91dd-e6fc80d03e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0329fd1-1aef-4088-a15d-cd969412910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0329fd1-1aef-4088-a15d-cd969412910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e32e7bccb85461abf60ee0a68f34c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:31Z,use_quota=True,user_id='37f7b75d3a5b4eae84e1f93026a733dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d7a516-923a-4798-aa8f-4400a006c353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d7a516-923a-4798-aa8f-4400a006c353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b6067d-112a-41e7-8714-aae8116dce8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b6067d-112a-41e7-8714-aae8116dce8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452', 'volume_name': 'volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805a1ad4-319d-4342-a8fd-c1ea427596f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805a1ad4-319d-4342-a8fd-c1ea427596f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff4068a-69e8-4014-b737-b9fca9821ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:31 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Volume cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452', 'volume_size': 1} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e32e7bccb85461abf60ee0a68f34c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:31Z,use_quota=True,user_id='37f7b75d3a5b4eae84e1f93026a733dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Creating volume cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:31 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:31 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 1073741824 Apr 16 11:26:31 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:32 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 1073741824" returned: 0 in 1.328s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:32 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 Apr 16 11:26:32 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:33 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:33 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Flow 'volume_create_manager' (5424e4b6-8e61-46b3-9f47-1ac9de8ad929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c759f9-232e-4ce6-bfae-5401e79605f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452" returned: 0 in 1.191s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c759f9-232e-4ce6-bfae-5401e79605f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-951884638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab35443-3bc7-4da5-9b91-19667b426ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea9d1251c5642d5bd432559b2fecf18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:34Z,use_quota=True,user_id='4cdc3d64733d472299aa387912be8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34746196-55fc-4e4e-a948-7dff7eb1a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34746196-55fc-4e4e-a948-7dff7eb1a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d62f37-3f5c-437a-8f12-23a572142c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d62f37-3f5c-437a-8f12-23a572142c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab35443-3bc7-4da5-9b91-19667b426ea1', 'volume_name': 'volume-dab35443-3bc7-4da5-9b91-19667b426ea1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87eae9ab-b7a2-472e-9c10-eec7722553ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87eae9ab-b7a2-472e-9c10-eec7722553ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c78faa4-b750-4737-a2f1-99aed3232875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:34 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Volume dab35443-3bc7-4da5-9b91-19667b426ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab35443-3bc7-4da5-9b91-19667b426ea1', 'volume_size': 1} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-951884638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab35443-3bc7-4da5-9b91-19667b426ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea9d1251c5642d5bd432559b2fecf18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:34Z,use_quota=True,user_id='4cdc3d64733d472299aa387912be8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Creating volume dab35443-3bc7-4da5-9b91-19667b426ea1 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:34 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff4068a-69e8-4014-b737-b9fca9821ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8d096e-5ff3-4ddb-a53c-2bc2216de448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:34 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Volume volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 (cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452): created successfully Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8d096e-5ff3-4ddb-a53c-2bc2216de448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:34 devstack sudo[86928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 1073741824 Apr 16 11:26:34 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Flow 'volume_create_manager' (7df6d45f-e627-4f0e-91dd-e6fc80d03e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:34 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-78d49aa0-64b7-4599-b904-f396157a5d3d tempest-VolumesListAdminTestJSON-566154171 None] Created volume successfully. Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Acquiring lock "cinder-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Lock "cinder-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Acquiring lock "cinder-quobyte-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "cinder-68e0a113-8b9e-4834-95e9-43756b38673e-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Lock "cinder-quobyte-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-68e0a113-8b9e-4834-95e9-43756b38673e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad86213-14f6-429c-8899-87bbe5d16726]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "cinder-quobyte-68e0a113-8b9e-4834-95e9-43756b38673e" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-quobyte-68e0a113-8b9e-4834-95e9-43756b38673e" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[06edce80-2b70-491d-9887-c9635b48ed5f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:35 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 1073741824" returned: 0 in 1.065s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:35 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 Apr 16 11:26:35 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:35 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e Apr 16 11:26:35 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:35 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 Apr 16 11:26:35 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:35 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1" returned: 0 in 0.637s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c78faa4-b750-4737-a2f1-99aed3232875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab35443-3bc7-4da5-9b91-19667b426ea1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adaeb01-daab-4150-a71e-ee6c0470d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:35 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Volume volume-dab35443-3bc7-4da5-9b91-19667b426ea1 (dab35443-3bc7-4da5-9b91-19667b426ea1): created successfully Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adaeb01-daab-4150-a71e-ee6c0470d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Flow 'volume_create_manager' (5424e4b6-8e61-46b3-9f47-1ac9de8ad929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a489ea92-7ab5-45e7-8c6f-4b84b35a7537 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Created volume successfully. Apr 16 11:26:35 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e" returned: 0 in 0.825s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:36 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e Apr 16 11:26:36 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Acquiring lock "cinder-638b8b68-843b-46cb-a503-dcc45786f76e-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "cinder-638b8b68-843b-46cb-a503-dcc45786f76e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:36 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452" returned: 0 in 1.233s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Acquiring lock "cinder-quobyte-638b8b68-843b-46cb-a503-dcc45786f76e" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:36 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452 Apr 16 11:26:36 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "cinder-quobyte-638b8b68-843b-46cb-a503-dcc45786f76e" acquired by "delete_volume" :: waited 0.056s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9e6d8-d69e-4de0-b0d8-b12a9841530a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:36 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e Apr 16 11:26:36 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:36 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-68e0a113-8b9e-4834-95e9-43756b38673e" returned: 0 in 0.693s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-quobyte-68e0a113-8b9e-4834-95e9-43756b38673e" released by "delete_volume" :: held 1.554s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Created reservations ['93ec7657-f22a-4b5e-9b5b-bdde33738740', '6382e560-89ad-491a-af67-a0ec18f7dda4', '246a4d9e-c284-4fbc-ad45-8f3fe86cb660', '1ceb4849-6055-4f1a-8972-fcd82170b5d8'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:36 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:36 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Acquiring lock "cinder-dab35443-3bc7-4da5-9b91-19667b426ea1-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "cinder-dab35443-3bc7-4da5-9b91-19667b426ea1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Acquiring lock "cinder-quobyte-dab35443-3bc7-4da5-9b91-19667b426ea1" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "cinder-quobyte-dab35443-3bc7-4da5-9b91-19667b426ea1" acquired by "delete_volume" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c3b35-b1e2-4bc1-9d3f-39e892fb5b84]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "cinder-826160ef-46b9-456a-ac56-bd7f9f989b96-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-826160ef-46b9-456a-ac56-bd7f9f989b96-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:37 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452" returned: 0 in 1.500s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "cinder-quobyte-826160ef-46b9-456a-ac56-bd7f9f989b96" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:37 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.092s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Lock "cinder-quobyte-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452" released by "delete_volume" :: held 2.838s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-quobyte-826160ef-46b9-456a-ac56-bd7f9f989b96" acquired by "delete_volume" :: waited 0.061s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:37 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 Apr 16 11:26:37 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:37 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Deleted volume successfully. Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31504b81-3e5a-4762-9ee7-25b7188c933e tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-68e0a113-8b9e-4834-95e9-43756b38673e-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a9bde1-ec75-4770-8e53-52b4fb804b2d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Created reservations ['0c3fd8ca-9c9b-4192-8d2f-a8238c12878b', 'a712d4e0-2982-4232-bb1f-bb7046812306', '55399bfa-7643-4f8a-a4a2-7a0161e3a0ba', 'd1c80437-0aa2-40d6-b621-501a5b8921ec'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:38 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 Apr 16 11:26:38 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:38 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e" returned: 0 in 1.858s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:38 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:38 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:38 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e Apr 16 11:26:38 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:39 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-638b8b68-843b-46cb-a503-dcc45786f76e" returned: 0 in 1.191s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:39 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96" returned: 0 in 1.480s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "cinder-quobyte-638b8b68-843b-46cb-a503-dcc45786f76e" released by "delete_volume" :: held 3.130s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:39 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1" returned: 0 in 2.074s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:39 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96 Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:39 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:39 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1 Apr 16 11:26:39 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Created reservations ['edb64f37-d2ea-4997-b43d-64921adce86b', '64f241f7-d37c-49a5-8180-8f634ffeeaca', 'eaf417b4-8b01-4931-9c73-3048bb47e09b', '49258ac0-f424-47ae-b7aa-636fb54d558f'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:39 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:39 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:40 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Flow 'volume_create_manager' (ce284e8f-2d99-47bf-a919-b1271c58e1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51877267-f4d8-457e-8a4a-77f4d1fc7316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 2.194s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:40 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Deleted volume successfully. Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51877267-f4d8-457e-8a4a-77f4d1fc7316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:40Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47867be-92c9-4068-8f95-67dbaa493047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04746a7f58c54123a1f3dcb4a66c8335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:40Z,use_quota=True,user_id='341c7895793647b889cf15821e8d6e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38466b7-461b-4605-9302-cc3c55a3fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38466b7-461b-4605-9302-cc3c55a3fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7449c71b-aa27-4cda-8a14-0a1a48da40f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.image.glance [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Creating Keystone auth plugin from conf {{(pid=83804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 11:26:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-26a41950-b0be-4320-b668-110bb5a8d29e tempest-VolumesListAdminTestJSON-566154171 None] Lock "cinder-cd2116f3-e67b-4aa2-b4e0-9fbfc9aae452-delete_volume" released by "delete_volume" :: held 5.741s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7449c71b-aa27-4cda-8a14-0a1a48da40f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e47867be-92c9-4068-8f95-67dbaa493047', 'volume_name': 'volume-e47867be-92c9-4068-8f95-67dbaa493047', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae9733a-b3ae-419e-91e1-f713894a84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae9733a-b3ae-419e-91e1-f713894a84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67174c8-187d-46a2-af2b-1c30e3cb4b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:41 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Volume e47867be-92c9-4068-8f95-67dbaa493047: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e47867be-92c9-4068-8f95-67dbaa493047', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Trying to clone e47867be-92c9-4068-8f95-67dbaa493047 from image 7a555815-8ed6-4460-8cae-4d0c09c11911 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]). {{(pid=83804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 11:26:41 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:41 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.727s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-826160ef-46b9-456a-ac56-bd7f9f989b96" returned: 0 in 2.100s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:41 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Deleted volume successfully. Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-quobyte-826160ef-46b9-456a-ac56-bd7f9f989b96" released by "delete_volume" :: held 3.748s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-174f64a4-25b0-447f-b4f6-66fddb5b166c tempest-ServerRescueNegativeTestJSON-1776745641 None] Lock "cinder-638b8b68-843b-46cb-a503-dcc45786f76e-delete_volume" released by "delete_volume" :: held 5.437s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Created reservations ['c805528d-9402-4b14-9d65-9f464171e397', 'b23b091e-8ad1-48d9-af7f-59c6abadc81c', 'c5cad60e-b011-4ba7-8b1f-89c7906e98f5', '04aeb38d-76bc-4a1f-acbe-3be4a2939605'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:41 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:41 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:41 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-dab35443-3bc7-4da5-9b91-19667b426ea1" returned: 0 in 2.302s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "cinder-quobyte-dab35443-3bc7-4da5-9b91-19667b426ea1" released by "delete_volume" :: held 4.481s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 11:26:42 devstack cinder-volume[83804]: INFO cinder.image.image_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Image download 20.69 MB at 20.69 MB/s Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Created reservations ['283ca5c1-bd76-4f18-a9c2-feb9091c3a75', '85c5207e-c5ed-4246-b6e7-e3497145f635', '79893fbc-870f-4a5b-b76c-df0498e9cc6a', '7d2c5813-b6ef-4cad-905d-6780e795c6a8'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69a92de-da49-4cda-99bd-9641b68b330c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:42 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD Apr 16 11:26:42 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:42 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:42 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "cinder-f589edd5-9ef4-44a2-99b9-0497a5e309b5-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-f589edd5-9ef4-44a2-99b9-0497a5e309b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "cinder-quobyte-f589edd5-9ef4-44a2-99b9-0497a5e309b5" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-quobyte-f589edd5-9ef4-44a2-99b9-0497a5e309b5" acquired by "delete_volume" :: waited 0.021s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdb7071-c924-4742-af8f-9dcbcdc61853]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:42 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 Apr 16 11:26:42 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:43 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.267s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Deleted volume successfully. Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c6f5e2e-a432-471c-b23d-b73e1c8114e0 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-826160ef-46b9-456a-ac56-bd7f9f989b96-delete_volume" released by "delete_volume" :: held 5.386s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:43 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.001s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Deleted volume successfully. Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-691d786b-8b24-4b9c-979b-5dd053cdbf17 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "cinder-dab35443-3bc7-4da5-9b91-19667b426ea1-delete_volume" released by "delete_volume" :: held 5.906s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:43 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD" returned: 0 in 1.585s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 is fetched for user 341c7895793647b889cf15821e8d6e11. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a088df8d-008f-49e1-8624-7a47a55b5071]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Flow 'volume_create_manager' (33648a96-3170-4f5e-9e92-679ab4b833bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018d3937-bd67-4e6b-ba76-82ea0da84bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:44 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD Apr 16 11:26:44 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018d3937-bd67-4e6b-ba76-82ea0da84bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-51800100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d30d7ec-2c12-43fa-ac1f-abace952792f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea9d1251c5642d5bd432559b2fecf18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:44Z,use_quota=True,user_id='4cdc3d64733d472299aa387912be8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328c7723-48e1-415e-ac19-7e0ab6a422f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328c7723-48e1-415e-ac19-7e0ab6a422f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed93f427-c094-447d-9d13-7d031511143e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed93f427-c094-447d-9d13-7d031511143e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d30d7ec-2c12-43fa-ac1f-abace952792f', 'volume_name': 'volume-0d30d7ec-2c12-43fa-ac1f-abace952792f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18c5e1b-866b-4bf6-bbec-73734f6e157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18c5e1b-866b-4bf6-bbec-73734f6e157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c52253-6b95-4a08-b176-493f0d8d504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:44 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Volume 0d30d7ec-2c12-43fa-ac1f-abace952792f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d30d7ec-2c12-43fa-ac1f-abace952792f', 'volume_size': 1} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-51800100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d30d7ec-2c12-43fa-ac1f-abace952792f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea9d1251c5642d5bd432559b2fecf18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:44Z,use_quota=True,user_id='4cdc3d64733d472299aa387912be8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Creating volume 0d30d7ec-2c12-43fa-ac1f-abace952792f {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:44 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:44 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f 1073741824 Apr 16 11:26:44 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:44 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5" returned: 0 in 1.558s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:44 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5 Apr 16 11:26:44 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:44 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:45 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f589edd5-9ef4-44a2-99b9-0497a5e309b5" returned: 0 in 0.777s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-quobyte-f589edd5-9ef4-44a2-99b9-0497a5e309b5" released by "delete_volume" :: held 2.378s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Created reservations ['3e12df9f-7d57-4cd4-b720-e8f9b6247345', '0b9a99bf-f2f6-4fef-8105-9d7c4d6a27b4', '302b1d8b-8c93-4f7e-9cc0-73e9e77db520', 'a46eeec4-be30-48a3-a486-24153592c95b'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:45 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:45 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:45 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f 1073741824" returned: 0 in 1.148s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:45 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f Apr 16 11:26:45 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:45 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.614s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:45 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Deleted volume successfully. Apr 16 11:26:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d9b53ad3-204c-4648-b769-fbe5c76a8517 tempest-VolumesListAdminTestJSON-514830597 None] Lock "cinder-f589edd5-9ef4-44a2-99b9-0497a5e309b5-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:46 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f" returned: 0 in 0.627s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:40Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47867be-92c9-4068-8f95-67dbaa493047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04746a7f58c54123a1f3dcb4a66c8335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:40Z,use_quota=True,user_id='341c7895793647b889cf15821e8d6e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Creating volume e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:46 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c52253-6b95-4a08-b176-493f0d8d504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d30d7ec-2c12-43fa-ac1f-abace952792f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf557d39-1d10-42bf-bf84-8b95bbd85d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:46 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 1073741824 Apr 16 11:26:46 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:46 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Volume volume-0d30d7ec-2c12-43fa-ac1f-abace952792f (0d30d7ec-2c12-43fa-ac1f-abace952792f): created successfully Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf557d39-1d10-42bf-bf84-8b95bbd85d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Flow 'volume_create_manager' (33648a96-3170-4f5e-9e92-679ab4b833bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8db33bb3-4a70-4473-b024-2230ae7bd095 tempest-VolumeQuotasAdminTestJSON-1664933265 None] Created volume successfully. Apr 16 11:26:46 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 1073741824" returned: 0 in 0.817s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:46 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:26:46 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:47 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 0 in 0.904s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:47 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Attempting download of 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume e47867be-92c9-4068-8f95-67dbaa493047. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 11:26:47 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[547bb3da-4117-41ed-ba0c-3244d1e3e62d]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_mx1efiai {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:47 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_mx1efiai Apr 16 11:26:47 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:48 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ec9d6333-7176-4290-9a47-86a8f630a667 tempest-VolumeQuotasAdminTestJSON-770839593 None] Transfer volume completed successfully. Apr 16 11:26:48 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_mx1efiai" returned: 0 in 0.922s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_mx1efiai {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:48 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_mx1efiai Apr 16 11:26:48 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Acquiring lock "cinder-0d30d7ec-2c12-43fa-ac1f-abace952792f-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Lock "cinder-0d30d7ec-2c12-43fa-ac1f-abace952792f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Acquiring lock "cinder-quobyte-0d30d7ec-2c12-43fa-ac1f-abace952792f" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Lock "cinder-quobyte-0d30d7ec-2c12-43fa-ac1f-abace952792f" acquired by "delete_volume" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9916f3ab-61e9-42b1-8439-346b51747f4a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:49 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f Apr 16 11:26:49 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:49 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_mx1efiai" returned: 1 in 0.915s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_mx1efiai' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e59c2-ac0a-4478-9c6e-825fcc45dfaa]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:49 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD Apr 16 11:26:49 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:50 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD" returned: 0 in 0.859s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:50 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] 7a555815-8ed6-4460-8cae-4d0c09c11911 was qcow2, converting to raw {{(pid=83804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 11:26:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:50 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:26:50 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:50 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f" returned: 0 in 1.323s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:50 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f Apr 16 11:26:50 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:51 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0d30d7ec-2c12-43fa-ac1f-abace952792f" returned: 0 in 0.860s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Lock "cinder-quobyte-0d30d7ec-2c12-43fa-ac1f-abace952792f" released by "delete_volume" :: held 2.231s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Created reservations ['ed755d42-f425-4b92-96a9-1cb341a7bae1', 'a8966093-caeb-4163-a8c7-6de6797bcc33', '934b501e-3474-4655-b164-3b808d2fea26', 'a735be26-b725-479f-abcb-60ddbd67af67'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:51 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:26:51 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:51 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 0 in 1.350s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_35fo05nfdevstack@QuobyteHD, size 112.00 MB, duration 1.35 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:26:51 devstack cinder-volume[83804]: INFO cinder.image.image_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Converted 112.00 MB image at 82.84 MB/s Apr 16 11:26:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:51 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 1G Apr 16 11:26:52 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:52 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.694s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:52 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:26:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Deleted volume successfully. Apr 16 11:26:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-075a0845-3087-42d4-920e-ae458ca20a24 tempest-VolumeQuotasAdminTestJSON-1268051477 None] Lock "cinder-0d30d7ec-2c12-43fa-ac1f-abace952792f-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:26:52 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 1G" returned: 0 in 0.623s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:52 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4709b5bc-7c5c-4a8c-a0f3-05ae52f2256c]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:52 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:26:52 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Flow 'volume_create_manager' (3dcbc7f5-5fd3-4949-8edc-8bd325c15e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a16eb01-c090-4cdc-a973-24e43011b428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a16eb01-c090-4cdc-a973-24e43011b428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-583738749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7592cf-78ee-40af-96cc-e840018f5c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4451c302b89b46af9795e6206acdc612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:53Z,use_quota=True,user_id='5cf12978756043d9aae97c42ef761e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa5067d-3841-4b4b-97cf-7d5f038c05e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa5067d-3841-4b4b-97cf-7d5f038c05e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883c0f80-26ee-43e9-a4f9-f96894c3fc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883c0f80-26ee-43e9-a4f9-f96894c3fc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7592cf-78ee-40af-96cc-e840018f5c55', 'volume_name': 'volume-0c7592cf-78ee-40af-96cc-e840018f5c55', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01ce5a7-67bc-41c7-a78d-be7f8d9b4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01ce5a7-67bc-41c7-a78d-be7f8d9b4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aee3b41-3097-4b35-a2aa-506bee674796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:53 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Volume 0c7592cf-78ee-40af-96cc-e840018f5c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7592cf-78ee-40af-96cc-e840018f5c55', 'volume_size': 1} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-583738749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7592cf-78ee-40af-96cc-e840018f5c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4451c302b89b46af9795e6206acdc612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:26:53Z,use_quota=True,user_id='5cf12978756043d9aae97c42ef761e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Creating volume 0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:26:53 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:53 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 1073741824 Apr 16 11:26:53 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:53 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 0 in 0.746s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:53 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:26:53 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:53 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 1073741824" returned: 0 in 0.577s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:53 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 Apr 16 11:26:53 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:54 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 1 in 0.684s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Downloaded image 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume e47867be-92c9-4068-8f95-67dbaa493047 successfully. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 for user 341c7895793647b889cf15821e8d6e11 is deleted. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Marking volume e47867be-92c9-4068-8f95-67dbaa493047 as bootable. {{(pid=83804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Copying metadata from image 7a555815-8ed6-4460-8cae-4d0c09c11911 to e47867be-92c9-4068-8f95-67dbaa493047. {{(pid=83804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Creating volume glance metadata for volume e47867be-92c9-4068-8f95-67dbaa493047 backed by image 7a555815-8ed6-4460-8cae-4d0c09c11911 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67174c8-187d-46a2-af2b-1c30e3cb4b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47867be-92c9-4068-8f95-67dbaa493047', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4011b6-5244-4d0a-96b9-718d0c06a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:54 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Volume volume-e47867be-92c9-4068-8f95-67dbaa493047 (e47867be-92c9-4068-8f95-67dbaa493047): created successfully Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4011b6-5244-4d0a-96b9-718d0c06a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Flow 'volume_create_manager' (ce284e8f-2d99-47bf-a919-b1271c58e1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-ab8fd7a5-ffe7-49f3-9b24-47e0736d22f9 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Created volume successfully. Apr 16 11:26:54 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55" returned: 0 in 0.596s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aee3b41-3097-4b35-a2aa-506bee674796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7592cf-78ee-40af-96cc-e840018f5c55', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be85c61b-a4eb-4c4f-b73f-8e6fcc37d658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:26:54 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Volume volume-0c7592cf-78ee-40af-96cc-e840018f5c55 (0c7592cf-78ee-40af-96cc-e840018f5c55): created successfully Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be85c61b-a4eb-4c4f-b73f-8e6fcc37d658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:26:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Flow 'volume_create_manager' (3dcbc7f5-5fd3-4949-8edc-8bd325c15e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:26:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b8f64d10-e81a-4acb-a91e-a7bfca6e29ec tempest-SnapshotMetadataTestJSON-109251077 None] Created volume successfully. Apr 16 11:26:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Creating offline snapshot 46bc03a1-57a4-48c1-90be-731191b83683 of volume 0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:26:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ebe16-2286-43e5-a10d-b0a1c19236e9]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:55 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 Apr 16 11:26:55 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:26:56 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55" returned: 0 in 1.029s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:56 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 1G Apr 16 11:26:56 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:57 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 1G" returned: 0 in 0.708s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c7592cf-78ee-40af-96cc-e840018f5c55 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:57 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c7592cf-78ee-40af-96cc-e840018f5c55 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 Apr 16 11:26:57 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:57 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c7592cf-78ee-40af-96cc-e840018f5c55 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683" returned: 0 in 0.728s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:57 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 is being set with open permissions: ugo+rw Apr 16 11:26:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:57 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 Apr 16 11:26:57 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:58 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683" returned: 0 in 0.531s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:58 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.info Apr 16 11:26:58 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:58 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.info" returned: 0 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:58 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.info is being set with open permissions: ugo+rw Apr 16 11:26:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:59 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.info Apr 16 11:26:59 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:26:59 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 16 11:26:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.info" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:26:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.092s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:26:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.215s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:26:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ab8aae51-f324-4a0a-9999-4ba7154d8352 tempest-SnapshotMetadataTestJSON-109251077 None] Create snapshot completed successfully Apr 16 11:26:59 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[65234b41-bfa6-4e50-aa55-f84dc2fa486e]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:26:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:26:59 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:26:59 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:00 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 0 in 0.610s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:00 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:27:00 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:00 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 1 in 0.650s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:27:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.295s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253', 'name': 'volume-e47867be-92c9-4068-8f95-67dbaa493047', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9cb0b6a-0e07-4197-8c40-137f61f30d5e', 'enforce_multipath': True} {{(pid=83804) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 11:27:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-511f873a-93a3-4c70-87ef-8300f84baa11 req-8362ef66-bc0f-403c-8f7c-4a7bad6c5f5d tempest-ServerBootFromVolumeStableRescueTest-574443085 None] attachment_update completed successfully. Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "cinder-46bc03a1-57a4-48c1-90be-731191b83683-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-46bc03a1-57a4-48c1-90be-731191b83683-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "cinder-quobyte-0c7592cf-78ee-40af-96cc-e840018f5c55" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-quobyte-0c7592cf-78ee-40af-96cc-e840018f5c55" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "cinder-quobyte-46bc03a1-57a4-48c1-90be-731191b83683" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-quobyte-46bc03a1-57a4-48c1-90be-731191b83683" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Deleting offline snapshot 46bc03a1-57a4-48c1-90be-731191b83683 of volume 0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] snapshot_file for this snap is: volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1aaa1-9c49-4873-8571-8b6c17e38299]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:01 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 Apr 16 11:27:01 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=115,cinder:SELECT=88,cinder:INSERT=36,cinder:DELETE=11 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Flow 'volume_create_manager' (b926072a-d936-4679-bcab-6c465e1ba709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ad7237-8b0f-4237-b367-ce8a752b9a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ad7237-8b0f-4237-b367-ce8a752b9a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1620214612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1258137-a05f-47d5-9e13-236dfea19840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8d5f56b3214b73b8fb4d5f3984bdfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:02Z,use_quota=True,user_id='b04cce1ba8864e4ead8301dfa6aa0add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4d948-f04f-4cd7-ba56-9fffc0bd3e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4d948-f04f-4cd7-ba56-9fffc0bd3e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d702c6a-33de-4f4f-8526-e3ec3465ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d702c6a-33de-4f4f-8526-e3ec3465ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1258137-a05f-47d5-9e13-236dfea19840', 'volume_name': 'volume-e1258137-a05f-47d5-9e13-236dfea19840', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774758b1-3cc2-46ca-aeca-d39f3312e1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774758b1-3cc2-46ca-aeca-d39f3312e1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a6539d-baef-418c-8d5a-d2fbf2275a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:01 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Volume e1258137-a05f-47d5-9e13-236dfea19840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1258137-a05f-47d5-9e13-236dfea19840', 'volume_size': 1} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1620214612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1258137-a05f-47d5-9e13-236dfea19840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8d5f56b3214b73b8fb4d5f3984bdfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:02Z,use_quota=True,user_id='b04cce1ba8864e4ead8301dfa6aa0add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Creating volume e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:01 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:01 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 1073741824 Apr 16 11:27:01 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:02 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683" returned: 0 in 0.632s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c7592cf-78ee-40af-96cc-e840018f5c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[df951877-b294-47de-b3ae-0ba591663fb0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:02 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 Apr 16 11:27:02 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:02 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 1073741824" returned: 0 in 0.704s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:02 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 Apr 16 11:27:02 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:02 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55" returned: 0 in 0.641s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:02 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 Apr 16 11:27:02 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:03 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a6539d-baef-418c-8d5a-d2fbf2275a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1258137-a05f-47d5-9e13-236dfea19840', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4371b9fa-efcd-4311-8876-6bdc253e6723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:03 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Volume volume-e1258137-a05f-47d5-9e13-236dfea19840 (e1258137-a05f-47d5-9e13-236dfea19840): created successfully Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4371b9fa-efcd-4311-8876-6bdc253e6723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Flow 'volume_create_manager' (b926072a-d936-4679-bcab-6c465e1ba709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c542af9b-75cb-44a5-a798-7d9b81d54925 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Created volume successfully. Apr 16 11:27:03 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683" returned: 0 in 0.531s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:03 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683 Apr 16 11:27:03 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:03 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55.46bc03a1-57a4-48c1-90be-731191b83683" returned: 0 in 0.551s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-quobyte-46bc03a1-57a4-48c1-90be-731191b83683" released by "_delete_snapshot" :: held 2.427s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-quobyte-0c7592cf-78ee-40af-96cc-e840018f5c55" released by "delete_snapshot" :: held 2.440s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=112,cinder:SELECT=95,cinder:INSERT=26,cinder:DELETE=7 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:27:03 devstack cinder-volume[83804]: WARNING cinder.quota [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Created reservations ['d8e9b8f1-1a23-4cd9-9a23-ac3811028e80', '9b6d316f-3fbc-4d46-ac3e-b99367a51efb', '8180be95-eea7-40ea-98e6-425bc202c98b', 'a5f6fa1d-b2a5-4e28-a995-0ab20d1d8aae'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Delete snapshot completed successfully. Apr 16 11:27:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6c0d3239-426f-4915-89cf-199aeab72b8b tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-46bc03a1-57a4-48c1-90be-731191b83683-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Creating offline snapshot dea88fca-f527-4aaa-9159-1044381fbefd of volume e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eed341-e323-439c-8baa-8441d3a637fa]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:04 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 Apr 16 11:27:04 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "cinder-0c7592cf-78ee-40af-96cc-e840018f5c55-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-0c7592cf-78ee-40af-96cc-e840018f5c55-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:04 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840" returned: 0 in 0.583s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:04 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd 1G Apr 16 11:27:04 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "cinder-quobyte-0c7592cf-78ee-40af-96cc-e840018f5c55" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-quobyte-0c7592cf-78ee-40af-96cc-e840018f5c55" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2442277-bf22-4519-9c52-b596970c12a1]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:04 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 Apr 16 11:27:04 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:05 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd 1G" returned: 0 in 0.707s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1258137-a05f-47d5-9e13-236dfea19840 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:05 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1258137-a05f-47d5-9e13-236dfea19840 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd Apr 16 11:27:05 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:05 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55" returned: 0 in 0.681s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:05 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55 Apr 16 11:27:05 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:06 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0c7592cf-78ee-40af-96cc-e840018f5c55" returned: 0 in 1.051s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-quobyte-0c7592cf-78ee-40af-96cc-e840018f5c55" released by "delete_volume" :: held 1.781s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Created reservations ['25a885ab-6124-42f9-afce-9c13ea02b22a', '65f3aafb-444c-4b66-8faf-a82033a6a028', '176f826b-9846-4b66-812c-3eccdaacc003', 'f0a9aee2-2948-423d-aa37-959aabb118f9'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:06 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:06 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:06 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1258137-a05f-47d5-9e13-236dfea19840 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd" returned: 0 in 1.561s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:06 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd is being set with open permissions: ugo+rw Apr 16 11:27:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:06 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd Apr 16 11:27:06 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:07 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd" returned: 0 in 0.636s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:07 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.info Apr 16 11:27:07 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:07 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.157s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:07 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:07 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Deleted volume successfully. Apr 16 11:27:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ee3cdf07-4424-4f4e-9f40-dd957eb5ac0a tempest-SnapshotMetadataTestJSON-109251077 None] Lock "cinder-0c7592cf-78ee-40af-96cc-e840018f5c55-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:08 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.info" returned: 0 in 0.745s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:08 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.info is being set with open permissions: ugo+rw Apr 16 11:27:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:08 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.info Apr 16 11:27:08 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:09 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.info" returned: 0 in 0.693s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:09 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e0ed6c4d-f981-43a0-af2c-c59799e66605 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Create snapshot completed successfully Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "cinder-dea88fca-f527-4aaa-9159-1044381fbefd-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-dea88fca-f527-4aaa-9159-1044381fbefd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "cinder-quobyte-e1258137-a05f-47d5-9e13-236dfea19840" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-quobyte-e1258137-a05f-47d5-9e13-236dfea19840" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "cinder-quobyte-dea88fca-f527-4aaa-9159-1044381fbefd" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-quobyte-dea88fca-f527-4aaa-9159-1044381fbefd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Deleting offline snapshot dea88fca-f527-4aaa-9159-1044381fbefd of volume e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] snapshot_file for this snap is: volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d67171-8c5b-4038-9b40-3830191d93d4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:10 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd Apr 16 11:27:10 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:10 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd" returned: 0 in 0.670s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1258137-a05f-47d5-9e13-236dfea19840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ec3be-729c-4e50-ad40-0ca03f6b3c72]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:10 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 Apr 16 11:27:10 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:10 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:10 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:11 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.770s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:11 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840" returned: 0 in 0.972s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:11 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd Apr 16 11:27:11 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:12 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd" returned: 0 in 0.591s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:12 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd Apr 16 11:27:12 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:12 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840.dea88fca-f527-4aaa-9159-1044381fbefd" returned: 0 in 0.496s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-quobyte-dea88fca-f527-4aaa-9159-1044381fbefd" released by "_delete_snapshot" :: held 2.950s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-quobyte-e1258137-a05f-47d5-9e13-236dfea19840" released by "delete_snapshot" :: held 2.974s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:12 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Created reservations ['0948673a-637d-4dca-a699-cab59853c860', '2d52c390-1cb1-4fa2-b77a-2552d8749e40', '890441c0-abc6-4740-be71-a0627573ef93', '999eca50-0938-4961-9014-54d8715e26b7'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:12 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Delete snapshot completed successfully. Apr 16 11:27:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a2f5b8b9-40d3-4868-8416-0fa196407eee tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-dea88fca-f527-4aaa-9159-1044381fbefd-delete_snapshot" released by "delete_snapshot" :: held 3.062s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "cinder-e1258137-a05f-47d5-9e13-236dfea19840-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-e1258137-a05f-47d5-9e13-236dfea19840-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "cinder-quobyte-e1258137-a05f-47d5-9e13-236dfea19840" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-quobyte-e1258137-a05f-47d5-9e13-236dfea19840" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdec334-3da4-4e3b-b757-f269811cdae3]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:13 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 Apr 16 11:27:13 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Flow 'volume_create_manager' (002b191e-7dc5-47cc-8131-3055e6bd3abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f38733-e6a0-446e-876a-1a2caa7a0141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f38733-e6a0-446e-876a-1a2caa7a0141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1957429219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60549475-f782-4f3b-b756-015704c77d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcf6c00c6ac4e57a4ac4e935fbe854b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:13Z,use_quota=True,user_id='f6adc0a5d4534186858f121f7e088dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea903db-2c48-43c9-b1ef-dabd4ee1a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea903db-2c48-43c9-b1ef-dabd4ee1a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b323c-e912-4710-9d05-5735a08441c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201b323c-e912-4710-9d05-5735a08441c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60549475-f782-4f3b-b756-015704c77d0c', 'volume_name': 'volume-60549475-f782-4f3b-b756-015704c77d0c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e60b1f-a99b-4f79-8ec7-e3366585cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e60b1f-a99b-4f79-8ec7-e3366585cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bf6910-b4f6-417f-9f52-5fe844905e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:13 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Volume 60549475-f782-4f3b-b756-015704c77d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60549475-f782-4f3b-b756-015704c77d0c', 'volume_size': 1} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1957429219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60549475-f782-4f3b-b756-015704c77d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcf6c00c6ac4e57a4ac4e935fbe854b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:13Z,use_quota=True,user_id='f6adc0a5d4534186858f121f7e088dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Creating volume 60549475-f782-4f3b-b756-015704c77d0c {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:13 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:13 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c 1073741824 Apr 16 11:27:13 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:13 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840" returned: 0 in 0.603s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:13 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840 Apr 16 11:27:13 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:13 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c 1073741824" returned: 0 in 0.640s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:13 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c Apr 16 11:27:13 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:14 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e1258137-a05f-47d5-9e13-236dfea19840" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-quobyte-e1258137-a05f-47d5-9e13-236dfea19840" released by "delete_volume" :: held 1.170s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Created reservations ['7ea0d014-e629-461d-bf24-4703978eda08', '7986a58e-10f0-41d9-a903-8de91a06b50a', '87fd1303-ec63-4f37-8cfc-85f4ee2b17b6', '6ec17e92-be5e-417a-a6db-54b747674166'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:14 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:14 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:14 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c" returned: 0 in 0.444s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bf6910-b4f6-417f-9f52-5fe844905e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60549475-f782-4f3b-b756-015704c77d0c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8ecc9c-3d6d-4851-99d1-ad07ede7d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:14 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Volume volume-60549475-f782-4f3b-b756-015704c77d0c (60549475-f782-4f3b-b756-015704c77d0c): created successfully Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8ecc9c-3d6d-4851-99d1-ad07ede7d534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Flow 'volume_create_manager' (002b191e-7dc5-47cc-8131-3055e6bd3abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b9c62c99-5179-43ba-b010-626f23f0fedf tempest-VolumesTransfersV357Test-965246571 None] Created volume successfully. Apr 16 11:27:14 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.427s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Deleted volume successfully. Apr 16 11:27:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ea32d4e7-0e9f-48a1-b1e2-0ef511796820 tempest-VolumeSnapshotQuotasNegativeTestJSON-2022467586 None] Lock "cinder-e1258137-a05f-47d5-9e13-236dfea19840-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:15 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c081b560-1b59-4746-b39d-1093d1f4320c tempest-VolumesTransfersV357Test-563382817 None] Transfer volume completed successfully. Apr 16 11:27:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Acquiring lock "cinder-60549475-f782-4f3b-b756-015704c77d0c-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-60549475-f782-4f3b-b756-015704c77d0c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Acquiring lock "cinder-quobyte-60549475-f782-4f3b-b756-015704c77d0c" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-quobyte-60549475-f782-4f3b-b756-015704c77d0c" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:17 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38f5aeb-e225-4073-bedc-179dfae21a35]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:17 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c Apr 16 11:27:17 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:17 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c" returned: 0 in 0.589s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:17 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c Apr 16 11:27:17 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:18 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-60549475-f782-4f3b-b756-015704c77d0c" returned: 0 in 0.458s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-quobyte-60549475-f782-4f3b-b756-015704c77d0c" released by "delete_volume" :: held 1.072s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Created reservations ['55d9d323-0fa8-4975-a782-0908cc890822', 'f82ad472-fb5a-4219-9b20-4b4d75da4bdd', '9f55c0e0-ae62-48c9-b4ca-c61679b8127c', '730e797a-a00d-401f-be99-670a92bf2f76'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:18 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:18 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:18 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Deleted volume successfully. Apr 16 11:27:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c5b9acc-56ba-45aa-b7b2-9e54b103f252 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-60549475-f782-4f3b-b756-015704c77d0c-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Flow 'volume_create_manager' (e28acea8-4a0d-4a15-8442-06b60c3665c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82239ba-1f6a-4574-9a3a-23d8b4a4b3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82239ba-1f6a-4574-9a3a-23d8b4a4b3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1033131752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1118d2c9-41ef-4da7-9005-7f7f27325d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bf6cfc43d749cdbecc0a91fe508b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:19Z,use_quota=True,user_id='f672b0b735904303abb048d2920268bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b746ff67-3da6-45f2-891c-18b72a98c89b),volume_type_id=b746ff67-3da6-45f2-891c-18b72a98c89b)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99d69ed-2091-472a-bf6b-7a3865753347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99d69ed-2091-472a-bf6b-7a3865753347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99333f3-dbf7-4f34-a83a-47ec753a9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99333f3-dbf7-4f34-a83a-47ec753a9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1118d2c9-41ef-4da7-9005-7f7f27325d74', 'volume_name': 'volume-1118d2c9-41ef-4da7-9005-7f7f27325d74', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbecca0-746b-4c17-a9f3-fa57121e67a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbecca0-746b-4c17-a9f3-fa57121e67a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd649d21-29e4-4448-b7c5-0baca26683af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Volume 1118d2c9-41ef-4da7-9005-7f7f27325d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1118d2c9-41ef-4da7-9005-7f7f27325d74', 'volume_size': 1} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1033131752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1118d2c9-41ef-4da7-9005-7f7f27325d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bf6cfc43d749cdbecc0a91fe508b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:19Z,use_quota=True,user_id='f672b0b735904303abb048d2920268bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b746ff67-3da6-45f2-891c-18b72a98c89b),volume_type_id=b746ff67-3da6-45f2-891c-18b72a98c89b)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Creating volume 1118d2c9-41ef-4da7-9005-7f7f27325d74 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:19 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:19 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 1073741824 Apr 16 11:27:19 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Flow 'volume_create_manager' (2bf1c705-8c63-4b27-a55d-8d203abc1d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537beb33-8a22-404a-bd0e-8727143ad611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537beb33-8a22-404a-bd0e-8727143ad611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2004870967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea3c07c-2119-4438-a17e-c702194f844c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcf6c00c6ac4e57a4ac4e935fbe854b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:20Z,use_quota=True,user_id='f6adc0a5d4534186858f121f7e088dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a558711-50e5-4549-805c-f93499b15d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a558711-50e5-4549-805c-f93499b15d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabc144c-af0e-4a82-8d43-aebcbdf4c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabc144c-af0e-4a82-8d43-aebcbdf4c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea3c07c-2119-4438-a17e-c702194f844c', 'volume_name': 'volume-4ea3c07c-2119-4438-a17e-c702194f844c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511aa12e-0780-4e96-982f-3e5c4552fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511aa12e-0780-4e96-982f-3e5c4552fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4d9abf-b678-46b4-9f34-c9132a0cef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:19 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Volume 4ea3c07c-2119-4438-a17e-c702194f844c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea3c07c-2119-4438-a17e-c702194f844c', 'volume_size': 1} Apr 16 11:27:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:20 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 1073741824" returned: 0 in 0.797s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:20 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 Apr 16 11:27:20 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:20 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74" returned: 0 in 0.524s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.089s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2004870967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea3c07c-2119-4438-a17e-c702194f844c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fcf6c00c6ac4e57a4ac4e935fbe854b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:20Z,use_quota=True,user_id='f6adc0a5d4534186858f121f7e088dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Creating volume 4ea3c07c-2119-4438-a17e-c702194f844c {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:20 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd649d21-29e4-4448-b7c5-0baca26683af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1118d2c9-41ef-4da7-9005-7f7f27325d74', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2fb880-1951-46af-a72b-affbd043e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:20 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c 1073741824 Apr 16 11:27:20 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:20 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Volume volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 (1118d2c9-41ef-4da7-9005-7f7f27325d74): created successfully Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2fb880-1951-46af-a72b-affbd043e686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Flow 'volume_create_manager' (e28acea8-4a0d-4a15-8442-06b60c3665c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7d23ef4b-82f7-4dcf-af70-fa53bef98593 tempest-VolumeTypesAccessTest-1983946120 None] Created volume successfully. Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Acquiring lock "cinder-1118d2c9-41ef-4da7-9005-7f7f27325d74-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Lock "cinder-1118d2c9-41ef-4da7-9005-7f7f27325d74-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Acquiring lock "cinder-quobyte-1118d2c9-41ef-4da7-9005-7f7f27325d74" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Lock "cinder-quobyte-1118d2c9-41ef-4da7-9005-7f7f27325d74" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[427a01f8-5822-4857-9bed-3019b8bab346]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:21 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 Apr 16 11:27:21 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:21 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c 1073741824" returned: 0 in 1.015s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:21 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c Apr 16 11:27:21 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:22 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74" returned: 0 in 0.808s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:22 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74 Apr 16 11:27:22 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:22 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c" returned: 0 in 0.786s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4d9abf-b678-46b4-9f34-c9132a0cef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea3c07c-2119-4438-a17e-c702194f844c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55e3fe6-62a5-4e43-a683-617602f8f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:22 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Volume volume-4ea3c07c-2119-4438-a17e-c702194f844c (4ea3c07c-2119-4438-a17e-c702194f844c): created successfully Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55e3fe6-62a5-4e43-a683-617602f8f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Flow 'volume_create_manager' (2bf1c705-8c63-4b27-a55d-8d203abc1d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:22 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-22815201-f6da-48de-8527-40da843a71d2 tempest-VolumesTransfersV357Test-965246571 None] Created volume successfully. Apr 16 11:27:23 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1118d2c9-41ef-4da7-9005-7f7f27325d74" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Lock "cinder-quobyte-1118d2c9-41ef-4da7-9005-7f7f27325d74" released by "delete_volume" :: held 1.359s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:23 devstack cinder-volume[83804]: WARNING cinder.quota [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-474421546 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-474421546, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:27:23 devstack cinder-volume[83804]: WARNING cinder.quota [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-474421546 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-474421546, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Created reservations ['b91d0d76-a126-4017-8ea4-d2787774e8d3', 'f71b19bc-959d-44df-85ef-73dc9485d2a3', 'a6f876e5-2bfb-4586-b887-8e1171744d86', '6a85740c-2eb1-4f0c-a246-37c6b2465955'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:23 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:23 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:23 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Deleted volume successfully. Apr 16 11:27:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-395f5607-155d-4f47-abb6-b9413882b6b7 tempest-VolumeTypesAccessTest-1983946120 None] Lock "cinder-1118d2c9-41ef-4da7-9005-7f7f27325d74-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Acquiring lock "cinder-4ea3c07c-2119-4438-a17e-c702194f844c-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-4ea3c07c-2119-4438-a17e-c702194f844c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Acquiring lock "cinder-quobyte-4ea3c07c-2119-4438-a17e-c702194f844c" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-quobyte-4ea3c07c-2119-4438-a17e-c702194f844c" acquired by "delete_volume" :: waited 0.021s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:24 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2477317a-6e3c-41f5-9b80-bf8729e6972c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:24 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c Apr 16 11:27:24 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:25 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c" returned: 0 in 1.376s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:26 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c Apr 16 11:27:26 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:26 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4ea3c07c-2119-4438-a17e-c702194f844c" returned: 0 in 0.919s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-quobyte-4ea3c07c-2119-4438-a17e-c702194f844c" released by "delete_volume" :: held 2.333s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Created reservations ['fd5328b8-2083-49fc-b2c9-c9044d67942d', 'eaf8a6ff-4402-4391-9639-c081009c27f7', 'c468eb90-97e6-4f0a-a955-2325aca438bf', 'c933ba6e-37e5-400d-b733-df2a78eb6095'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:27 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:27 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:27 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.675s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:27 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:27 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Deleted volume successfully. Apr 16 11:27:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4d17cf9-1971-4d2d-9d15-06d3a7d45258 tempest-VolumesTransfersV357Test-1973698595 None] Lock "cinder-4ea3c07c-2119-4438-a17e-c702194f844c-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:29 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-eac21159-ba60-4fd0-984f-dcb833d3a83c tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Terminate volume connection completed successfully. Apr 16 11:27:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-eac21159-ba60-4fd0-984f-dcb833d3a83c tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Deleting attachment a9cb0b6a-0e07-4197-8c40-137f61f30d5e. {{(pid=83804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 11:27:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "cinder-e47867be-92c9-4068-8f95-67dbaa493047-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-e47867be-92c9-4068-8f95-67dbaa493047-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "cinder-quobyte-e47867be-92c9-4068-8f95-67dbaa493047" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-quobyte-e47867be-92c9-4068-8f95-67dbaa493047" acquired by "delete_volume" :: waited 0.030s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:30 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[55482998-dff7-4ccd-907d-707346d0f1b4]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:30 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:27:30 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:31 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 0 in 1.102s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:32 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:27:32 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:32 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 1 in 0.791s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:27:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:32 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047 Apr 16 11:27:32 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Flow 'volume_create_manager' (13d6a0b6-6d8a-4bdc-b395-9c679dc996d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0936248-d6f2-4185-b76e-12983a38731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0936248-d6f2-4185-b76e-12983a38731c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1790187938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b11e01d-c09b-4d74-922e-e6c0e6e3c30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e60d7b530234f7e9f860f6016e8d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:33Z,use_quota=True,user_id='42c9fedbb7074ad0980bcc0ca245a91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df507d1-c7b8-40d3-87f8-048b51fcc4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df507d1-c7b8-40d3-87f8-048b51fcc4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bae77d-42cb-4c0d-828f-77f5d28d7ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bae77d-42cb-4c0d-828f-77f5d28d7ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b11e01d-c09b-4d74-922e-e6c0e6e3c30d', 'volume_name': 'volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4547d5-4b08-42ec-be9d-090da0c9391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4547d5-4b08-42ec-be9d-090da0c9391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8206d935-95dd-421d-8435-730ad6eec448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:33 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Volume 1b11e01d-c09b-4d74-922e-e6c0e6e3c30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d', 'volume_size': 1} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1790187938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b11e01d-c09b-4d74-922e-e6c0e6e3c30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e60d7b530234f7e9f860f6016e8d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:33Z,use_quota=True,user_id='42c9fedbb7074ad0980bcc0ca245a91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Creating volume 1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:33 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:33 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-e47867be-92c9-4068-8f95-67dbaa493047" returned: 0 in 0.885s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-quobyte-e47867be-92c9-4068-8f95-67dbaa493047" released by "delete_volume" :: held 2.911s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:33 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d 1073741824 Apr 16 11:27:33 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.quota [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Created reservations ['78ebeaa6-4f04-42eb-a824-0bde05f7f043', '14ea7504-7e83-409c-8c9f-e6b3e0a88f52', '8136594a-0d84-493d-9286-9ec53349856f', '9adfabb4-5c22-4db6-a68b-628d22068a80'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:33 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:33 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:34 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d 1073741824" returned: 0 in 0.981s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:34 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.867s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:34 devstack cinder-volume[83804]: DEBUG cinder.manager [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:34 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Deleted volume successfully. Apr 16 11:27:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-5c3d16c8-fd21-4cab-a9c7-5c406901603e req-b9e06c4e-adb0-4980-a8a4-4ea812bc4267 tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-e47867be-92c9-4068-8f95-67dbaa493047-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:34 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d Apr 16 11:27:34 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:35 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" returned: 0 in 0.517s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8206d935-95dd-421d-8435-730ad6eec448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaedb08-e7b1-4f8b-a098-59724047a453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:35 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Volume volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d (1b11e01d-c09b-4d74-922e-e6c0e6e3c30d): created successfully Apr 16 11:27:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaedb08-e7b1-4f8b-a098-59724047a453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Flow 'volume_create_manager' (13d6a0b6-6d8a-4bdc-b395-9c679dc996d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d7c55217-69b0-4963-9b7f-7a64b1fe09ed tempest-VolumesCloneTest-1163606014 None] Created volume successfully. Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Flow 'volume_create_manager' (73f5c04a-f508-4834-9f2e-72e48dd126d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af7d371-a875-4a7e-99a9-92c44e239a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af7d371-a875-4a7e-99a9-92c44e239a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1021867806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e60d7b530234f7e9f860f6016e8d5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1b11e01d-c09b-4d74-922e-e6c0e6e3c30d,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:37Z,use_quota=True,user_id='42c9fedbb7074ad0980bcc0ca245a91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eaf0e1-03fc-41c1-a15a-8c3b9b022e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eaf0e1-03fc-41c1-a15a-8c3b9b022e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0357068b-9188-495b-b40f-f344092ed933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0357068b-9188-495b-b40f-f344092ed933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d', 'volume_name': 'volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d', 'volume_size': 2, 'source_volid': '1b11e01d-c09b-4d74-922e-e6c0e6e3c30d', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82b8d25-43ca-4ee7-9911-0496dcddad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82b8d25-43ca-4ee7-9911-0496dcddad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92e4092-1e9f-4345-8f29-31597d993189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:36 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Volume cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d', 'volume_size': 2, 'source_volid': '1b11e01d-c09b-4d74-922e-e6c0e6e3c30d', 'source_volstatus': 'available'} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:36 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Cloning volume 1b11e01d-c09b-4d74-922e-e6c0e6e3c30d to volume cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Creating offline snapshot 4cde1b80-acf4-435c-b84e-a2ba288fe435 of volume 1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b2f13f-e13e-4969-b29b-dd19e77b040f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:36 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d Apr 16 11:27:36 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:37 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" returned: 0 in 0.962s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:37 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 1G Apr 16 11:27:37 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:38 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 1G" returned: 0 in 0.635s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:38 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 Apr 16 11:27:38 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:38 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435" returned: 0 in 0.646s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:39 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 is being set with open permissions: ugo+rw Apr 16 11:27:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:39 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 Apr 16 11:27:39 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:39 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435" returned: 0 in 0.594s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:39 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.info Apr 16 11:27:39 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:40 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.info" returned: 0 in 0.801s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:40 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.info is being set with open permissions: ugo+rw Apr 16 11:27:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:40 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.info Apr 16 11:27:40 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:41 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.info" returned: 0 in 0.711s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Acquiring lock "cinder-quobyte-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] snapshot: 4cde1b80-acf4-435c-b84e-a2ba288fe435, volume: cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ad5abf-a434-4eab-8540-996ad761eb7d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:41 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 Apr 16 11:27:41 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:42 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435" returned: 0 in 0.882s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:27:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:27:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:27:42 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a424b-f31f-4976-a116-2b12b855c715]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:42 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d Apr 16 11:27:42 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:43 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" returned: 0 in 0.962s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:43 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d Apr 16 11:27:43 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Flow 'volume_create_manager' (c23a54ad-a358-4a85-afb6-5437731f3c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a7eac2-819a-4af5-84a6-42bb27cc0dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a7eac2-819a-4af5-84a6-42bb27cc0dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-801307384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d328c7f-582c-4bff-9f77-ec20b11e1278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282f88b4e4214563a2bf5fad1bf37d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:43Z,use_quota=True,user_id='51fd491b665446ce8af6c203a5fc712d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6291b4b9-c68a-4c4f-ace6-a3b8ddd42526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6291b4b9-c68a-4c4f-ace6-a3b8ddd42526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4555e54b-c813-4d58-a668-4f077b9ac9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.image.glance [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Creating Keystone auth plugin from conf {{(pid=83804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4555e54b-c813-4d58-a668-4f077b9ac9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d328c7f-582c-4bff-9f77-ec20b11e1278', 'volume_name': 'volume-3d328c7f-582c-4bff-9f77-ec20b11e1278', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2440af66-9b49-4adf-80f1-104fe057a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2440af66-9b49-4adf-80f1-104fe057a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0393a837-7c25-49a6-8d34-ddd6ff803f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:43 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Volume 3d328c7f-582c-4bff-9f77-ec20b11e1278: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d328c7f-582c-4bff-9f77-ec20b11e1278', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 11:27:43 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Trying to clone 3d328c7f-582c-4bff-9f77-ec20b11e1278 from image 7a555815-8ed6-4460-8cae-4d0c09c11911 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]). {{(pid=83804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 11:27:44 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 11:27:44 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Image download 20.69 MB at 20.69 MB/s Apr 16 11:27:44 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dd5eda-f6ed-47fa-898b-840ac12492d1]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:44 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD Apr 16 11:27:44 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:46 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD" returned: 0 in 1.872s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:46 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 is fetched for user 51fd491b665446ce8af6c203a5fc712d. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 11:27:46 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1dda98-2c6c-43fe-baeb-134c41d7aed3]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:46 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD Apr 16 11:27:46 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:47 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" returned: 0 in 4.169s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e40e9d-8fe5-4872-bd40-b2fe6e27ddd7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:47 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d Apr 16 11:27:47 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:47 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD" returned: 0 in 0.980s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-8afc850e-b522-4726-9981-86d8404877ee tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Terminate volume connection completed successfully. Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-8afc850e-b522-4726-9981-86d8404877ee tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Deleting attachment 99617d10-6259-4964-9477-7bfe7620022f. {{(pid=83804) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 11:27:47 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" returned: 0 in 0.609s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d, size 1024.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:27:47 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Converted 1024.00 MB image at 245.54 MB/s Apr 16 11:27:47 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d is being set with open permissions: ugo+rw Apr 16 11:27:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:47 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d Apr 16 11:27:47 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "cinder-64806e93-d066-4f4e-8626-e271a69a189f-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-64806e93-d066-4f4e-8626-e271a69a189f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "cinder-quobyte-64806e93-d066-4f4e-8626-e271a69a189f" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-quobyte-64806e93-d066-4f4e-8626-e271a69a189f" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb3b6c6-c1a9-43b0-a879-f2d4d1b3e002]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:48 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f Apr 16 11:27:48 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:48 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" returned: 0 in 0.520s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" released by "_copy_volume_from_snapshot" :: held 7.243s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Acquiring lock "cinder-quobyte-4cde1b80-acf4-435c-b84e-a2ba288fe435" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-4cde1b80-acf4-435c-b84e-a2ba288fe435" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Deleting offline snapshot 4cde1b80-acf4-435c-b84e-a2ba288fe435 of volume 1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] snapshot_file for this snap is: volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e0475-64f2-4a8c-945b-fe1ca9335b7f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:48 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 Apr 16 11:27:48 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:48 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f" returned: 0 in 0.530s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:48 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f Apr 16 11:27:48 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:48 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435" returned: 0 in 0.517s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e28b1e-f778-493c-9717-eae02a86a34f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:49 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d Apr 16 11:27:49 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:49 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-64806e93-d066-4f4e-8626-e271a69a189f" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-quobyte-64806e93-d066-4f4e-8626-e271a69a189f" released by "delete_volume" :: held 1.064s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG cinder.quota [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Created reservations ['c7f15d17-0798-4062-b11d-a47fdf7511f1', '4ca84cf9-9f3a-4ab2-939b-567d1d778d5b', '75017816-2eac-4ecc-9c8d-8ccb3c578132', '868ffcc8-ed46-47b9-810d-84292a4061a2'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:49 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:49 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:49 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" returned: 0 in 0.532s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:49 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 Apr 16 11:27:49 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:49 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG cinder.manager [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:49 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Deleted volume successfully. Apr 16 11:27:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-1806312c-e79c-4f3f-b0fe-d7fe4c892674 req-00a27276-bade-4dc8-88ae-6cf028c53b1f tempest-ServerBootFromVolumeStableRescueTest-574443085 None] Lock "cinder-64806e93-d066-4f4e-8626-e271a69a189f-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:50 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435" returned: 0 in 0.488s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:50 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435 Apr 16 11:27:50 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:50 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d.4cde1b80-acf4-435c-b84e-a2ba288fe435" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-4cde1b80-acf4-435c-b84e-a2ba288fe435" released by "_delete_snapshot" :: held 2.047s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.814s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.043s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-801307384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d328c7f-582c-4bff-9f77-ec20b11e1278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282f88b4e4214563a2bf5fad1bf37d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:43Z,use_quota=True,user_id='51fd491b665446ce8af6c203a5fc712d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Creating volume 3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:50 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92e4092-1e9f-4345-8f29-31597d993189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d', 'volume_size': 2, 'source_volid': '1b11e01d-c09b-4d74-922e-e6c0e6e3c30d', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a7f6b3-af76-445e-bc5f-8b1caaf56089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:50 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 1073741824 Apr 16 11:27:50 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Volume volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d (cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d): created successfully Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a7f6b3-af76-445e-bc5f-8b1caaf56089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Flow 'volume_create_manager' (73f5c04a-f508-4834-9f2e-72e48dd126d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:50 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2cf070ce-8305-439b-ae72-caa874d77d7c tempest-VolumesCloneTest-1163606014 None] Created volume successfully. Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Flow 'volume_create_manager' (ae2a32e9-7473-46fe-800f-457fd364302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38ea77f-a281-4e0b-8bc8-2d3546fbd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38ea77f-a281-4e0b-8bc8-2d3546fbd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-294929798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcca339-49d0-4853-8381-9484c13f5ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e912ece7254016a9a8092879016006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:51Z,use_quota=True,user_id='faeb63f3c4334e93adfb2833f35669ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971dd489-7b5e-4d17-a5a9-6dedc521690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971dd489-7b5e-4d17-a5a9-6dedc521690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34fc319-5396-413e-8c81-90b3bb0cae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34fc319-5396-413e-8c81-90b3bb0cae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcca339-49d0-4853-8381-9484c13f5ef8', 'volume_name': 'volume-2bcca339-49d0-4853-8381-9484c13f5ef8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af01196-a636-48a9-a966-841db7fc73f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af01196-a636-48a9-a966-841db7fc73f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430c3452-f1f6-4a61-9047-22579658bb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Volume 2bcca339-49d0-4853-8381-9484c13f5ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcca339-49d0-4853-8381-9484c13f5ef8', 'volume_size': 1} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:51 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 1073741824" returned: 0 in 0.618s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:51 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 Apr 16 11:27:51 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:51 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278" returned: 0 in 0.479s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-294929798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcca339-49d0-4853-8381-9484c13f5ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e912ece7254016a9a8092879016006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:51Z,use_quota=True,user_id='faeb63f3c4334e93adfb2833f35669ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Creating volume 2bcca339-49d0-4853-8381-9484c13f5ef8 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:51 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Acquiring lock "cinder-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:51 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 1073741824 Apr 16 11:27:51 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Attempting download of 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume 3d328c7f-582c-4bff-9f77-ec20b11e1278. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Lock "cinder-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Acquiring lock "cinder-quobyte-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e548d2e-71ff-4e92-aafe-7597962d208e]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_cqynur4o {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47917d-0784-4b6c-9e7d-f821e346fcff]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:51 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_cqynur4o Apr 16 11:27:51 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:51 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d Apr 16 11:27:51 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:52 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 1073741824" returned: 0 in 0.565s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:52 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_cqynur4o" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_cqynur4o {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:52 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 Apr 16 11:27:52 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:52 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_cqynur4o Apr 16 11:27:52 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:52 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" returned: 0 in 0.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:52 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d Apr 16 11:27:52 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:52 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430c3452-f1f6-4a61-9047-22579658bb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcca339-49d0-4853-8381-9484c13f5ef8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6541adf-3d77-45a8-90b4-42c841727d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Volume volume-2bcca339-49d0-4853-8381-9484c13f5ef8 (2bcca339-49d0-4853-8381-9484c13f5ef8): created successfully Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6541adf-3d77-45a8-90b4-42c841727d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Flow 'volume_create_manager' (ae2a32e9-7473-46fe-800f-457fd364302a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7734d3ec-2399-475d-a443-0cbf586c0010 tempest-ServersNegativeTestJSON-428526505 None] Created volume successfully. Apr 16 11:27:52 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_cqynur4o" returned: 1 in 0.581s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_cqynur4o' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5584ce-8903-43d7-88ed-35f3f7579217]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:52 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" returned: 0 in 0.567s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d" released by "delete_volume" :: held 1.152s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Created reservations ['eff80a17-c12a-4103-a488-826b16725084', 'a06baa15-d270-4295-83ba-b474ae9c70dd', '3e7f76cc-f9d3-4d7c-99f9-ea0b720a926e', '58bf1845-4f8a-4b2e-ab99-6bf88e3dc010'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:52 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD Apr 16 11:27:52 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:53 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:53 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:53 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD" returned: 0 in 0.701s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] 7a555815-8ed6-4460-8cae-4d0c09c11911 was qcow2, converting to raw {{(pid=83804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:53 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 Apr 16 11:27:53 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:53 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.642s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Deleted volume successfully. Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ba095c53-6ce9-464d-a4dd-d24ff3191e0e tempest-VolumesCloneTest-1163606014 None] Lock "cinder-cc32fbcf-1e42-47cc-8ddb-11b7bf305a3d-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Acquiring lock "cinder-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Lock "cinder-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Acquiring lock "cinder-quobyte-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" acquired by "delete_volume" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f428e8d-fb79-4210-8d82-7e9b717e1dff]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:54 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d Apr 16 11:27:54 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Flow 'volume_create_manager' (6abb2070-c518-4a74-9a5e-defe246bd31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2241831f-9769-42c2-a9fb-da02d49f627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2241831f-9769-42c2-a9fb-da02d49f627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-243613342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690d36e4-f56b-4b11-8f10-9b2368e7e5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e912ece7254016a9a8092879016006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:54Z,use_quota=True,user_id='faeb63f3c4334e93adfb2833f35669ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced12a1b-26b4-4b75-9221-594753186aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced12a1b-26b4-4b75-9221-594753186aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac297cab-bc16-4fbc-ab0e-7915a08d2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac297cab-bc16-4fbc-ab0e-7915a08d2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690d36e4-f56b-4b11-8f10-9b2368e7e5dd', 'volume_name': 'volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ca3f2b-f6c5-46ea-b6be-fe4ec76f8856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ca3f2b-f6c5-46ea-b6be-fe4ec76f8856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e10522f-77b6-4930-909e-ecc44396c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:54 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Volume 690d36e4-f56b-4b11-8f10-9b2368e7e5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd', 'volume_size': 1} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-243613342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690d36e4-f56b-4b11-8f10-9b2368e7e5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e912ece7254016a9a8092879016006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:54Z,use_quota=True,user_id='faeb63f3c4334e93adfb2833f35669ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Creating volume 690d36e4-f56b-4b11-8f10-9b2368e7e5dd {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:54 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:54 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd 1073741824 Apr 16 11:27:54 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:54 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278" returned: 0 in 1.331s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_w0ljuspcdevstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:27:54 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Converted 112.00 MB image at 84.05 MB/s Apr 16 11:27:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:54 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 1G Apr 16 11:27:54 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:55 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" returned: 0 in 1.142s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:55 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd 1073741824" returned: 0 in 0.822s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:55 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d Apr 16 11:27:55 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:55 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd Apr 16 11:27:55 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:55 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 1G" returned: 0 in 0.580s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac50dbf-9e9b-4189-9e25-922bcc0585f7]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:55 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 Apr 16 11:27:55 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:55 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:55 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd" returned: 0 in 0.577s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" returned: 0 in 0.645s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e10522f-77b6-4930-909e-ecc44396c400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53933cb8-453d-49fa-a654-965d5ce0546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Lock "cinder-quobyte-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d" released by "delete_volume" :: held 1.863s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:55 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Volume volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd (690d36e4-f56b-4b11-8f10-9b2368e7e5dd): created successfully Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53933cb8-453d-49fa-a654-965d5ce0546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Flow 'volume_create_manager' (6abb2070-c518-4a74-9a5e-defe246bd31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:55 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-14180134-8d87-4527-8f78-d85b7c575737 tempest-ServersNegativeTestJSON-428526505 None] Created volume successfully. Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Created reservations ['c1b6a8fe-4256-4178-a684-08e4b5088b8e', '16883c2f-80a6-44d0-87a9-7484639f39d7', '53102aba-847e-4828-8ca1-52a83424be92', '69264cf0-8d0e-4fc9-abce-64ec8b24a8cb'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:55 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278" returned: 0 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:56 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:56 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:56 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 Apr 16 11:27:56 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:56 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.439s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Deleted volume successfully. Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e5ed1649-9601-4cfb-9f79-ae9b96f9fadd tempest-VolumesCloneTest-1163606014 None] Lock "cinder-1b11e01d-c09b-4d74-922e-e6c0e6e3c30d-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:56 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278" returned: 1 in 0.630s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Downloaded image 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume 3d328c7f-582c-4bff-9f77-ec20b11e1278 successfully. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 for user 51fd491b665446ce8af6c203a5fc712d is deleted. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Marking volume 3d328c7f-582c-4bff-9f77-ec20b11e1278 as bootable. {{(pid=83804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Copying metadata from image 7a555815-8ed6-4460-8cae-4d0c09c11911 to 3d328c7f-582c-4bff-9f77-ec20b11e1278. {{(pid=83804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Creating volume glance metadata for volume 3d328c7f-582c-4bff-9f77-ec20b11e1278 backed by image 7a555815-8ed6-4460-8cae-4d0c09c11911 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0393a837-7c25-49a6-8d34-ddd6ff803f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d328c7f-582c-4bff-9f77-ec20b11e1278', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f21a0f5-4e3d-46e9-9750-8b25eb9dd71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:56 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Volume volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 (3d328c7f-582c-4bff-9f77-ec20b11e1278): created successfully Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f21a0f5-4e3d-46e9-9750-8b25eb9dd71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Flow 'volume_create_manager' (c23a54ad-a358-4a85-afb6-5437731f3c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0ed1de31-7657-4c68-952c-1233b314da30 tempest-VolumesImageMetadata-895740920 None] Created volume successfully. Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "cinder-690d36e4-f56b-4b11-8f10-9b2368e7e5dd-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-690d36e4-f56b-4b11-8f10-9b2368e7e5dd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "cinder-quobyte-690d36e4-f56b-4b11-8f10-9b2368e7e5dd" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-quobyte-690d36e4-f56b-4b11-8f10-9b2368e7e5dd" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b778b80c-b743-460d-9d54-3c0f00aaddb2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:57 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd Apr 16 11:27:57 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:57 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd" returned: 0 in 0.559s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:57 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd Apr 16 11:27:57 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:58 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-690d36e4-f56b-4b11-8f10-9b2368e7e5dd" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-quobyte-690d36e4-f56b-4b11-8f10-9b2368e7e5dd" released by "delete_volume" :: held 1.136s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Flow 'volume_create_manager' (941f39c6-cb5a-48d1-942e-aba18fa384df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac60e41-cb34-4a8b-abea-228a86c18e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac60e41-cb34-4a8b-abea-228a86c18e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2136400190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4ea378-e99a-48e8-8096-b1572ee1e798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc0f30edcf24ac4a2582042c94fe038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:58Z,use_quota=True,user_id='92f08915d0cd42dab8e63047ce3dfe84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095144e3-364f-4edb-aa4f-a05716613a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095144e3-364f-4edb-aa4f-a05716613a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38498c0f-2af9-4cfb-8656-35323b074875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38498c0f-2af9-4cfb-8656-35323b074875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4ea378-e99a-48e8-8096-b1572ee1e798', 'volume_name': 'volume-ee4ea378-e99a-48e8-8096-b1572ee1e798', 'volume_size': 2}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be7f27c-44a1-49c2-a90e-154f0e5dc6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be7f27c-44a1-49c2-a90e-154f0e5dc6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1045bcf7-db4f-4d9e-ae1c-2d2d630d165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:58 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Volume ee4ea378-e99a-48e8-8096-b1572ee1e798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4ea378-e99a-48e8-8096-b1572ee1e798', 'volume_size': 2} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2136400190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4ea378-e99a-48e8-8096-b1572ee1e798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc0f30edcf24ac4a2582042c94fe038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:27:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:27:58Z,use_quota=True,user_id='92f08915d0cd42dab8e63047ce3dfe84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Creating volume ee4ea378-e99a-48e8-8096-b1572ee1e798 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:27:58 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 2147483648 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Acquiring lock "cinder-3d328c7f-582c-4bff-9f77-ec20b11e1278-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:58 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 2147483648 Apr 16 11:27:58 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Lock "cinder-3d328c7f-582c-4bff-9f77-ec20b11e1278-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Created reservations ['47ab199b-396c-4832-8f2e-1676e677f071', 'efb3f68a-b701-47b8-9af9-f56efed3aa16', '944e4997-546f-4847-92ea-1649556cf8a8', 'd7530f7f-e89a-4e93-be8d-14d461df8556'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Acquiring lock "cinder-quobyte-3d328c7f-582c-4bff-9f77-ec20b11e1278" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Lock "cinder-quobyte-3d328c7f-582c-4bff-9f77-ec20b11e1278" acquired by "delete_volume" :: waited 0.027s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2133ae70-e7dc-4632-97a6-af10926f79c0]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:58 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:58 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:58 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 Apr 16 11:27:58 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:58 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 2147483648" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:58 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 Apr 16 11:27:58 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:58 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.444s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:27:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Deleted volume successfully. Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c29f930d-6b59-4792-bec3-262d42937b8b tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-690d36e4-f56b-4b11-8f10-9b2368e7e5dd-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:58 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278" returned: 0 in 0.523s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:58 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 Apr 16 11:27:58 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "cinder-2bcca339-49d0-4853-8381-9484c13f5ef8-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-2bcca339-49d0-4853-8381-9484c13f5ef8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "cinder-quobyte-2bcca339-49d0-4853-8381-9484c13f5ef8" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:27:59 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798" returned: 0 in 0.455s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1045bcf7-db4f-4d9e-ae1c-2d2d630d165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4ea378-e99a-48e8-8096-b1572ee1e798', 'volume_size': 2}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ce2586-bb78-4b25-8340-ecb3019362f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-quobyte-2bcca339-49d0-4853-8381-9484c13f5ef8" acquired by "delete_volume" :: waited 0.031s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ef4b7-d23f-4b71-a473-ef67269c50a7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:59 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Volume volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 (ee4ea378-e99a-48e8-8096-b1572ee1e798): created successfully Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ce2586-bb78-4b25-8340-ecb3019362f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Flow 'volume_create_manager' (941f39c6-cb5a-48d1-942e-aba18fa384df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:27:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c949a063-bf3b-484c-a1cb-8336015b77af tempest-VolumesCloneNegativeTest-511280434 None] Created volume successfully. Apr 16 11:27:59 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 Apr 16 11:27:59 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:59 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278" returned: 1 in 0.530s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:59 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278 Apr 16 11:27:59 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:59 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8" returned: 0 in 0.580s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:59 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d328c7f-582c-4bff-9f77-ec20b11e1278" returned: 0 in 0.416s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:27:59 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8 Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Lock "cinder-quobyte-3d328c7f-582c-4bff-9f77-ec20b11e1278" released by "delete_volume" :: held 1.510s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:27:59 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Created reservations ['7ffa28d9-5129-4850-bb1a-39715ced3a44', '552f7ce0-aa22-407e-a40e-57f05782e92f', '1e2bad6b-a110-48d3-8b46-79d0f99a3d3d', 'a6998446-30ec-435a-9028-2fce3043e8a0'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:27:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:27:59 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:27:59 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:00 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2bcca339-49d0-4853-8381-9484c13f5ef8" returned: 0 in 0.452s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-quobyte-2bcca339-49d0-4853-8381-9484c13f5ef8" released by "delete_volume" :: held 1.054s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Created reservations ['0a649cf8-598f-4207-88b3-dfbf0fb19a41', '7bb76096-4f7a-4ef0-9411-4a69e28971a9', '077b42f6-2cb1-4aa3-981c-b8356d70b53e', '14cec76f-3a9e-4974-b3df-4049804de471'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:00 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.417s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Deleted volume successfully. Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Acquiring lock "cinder-ee4ea378-e99a-48e8-8096-b1572ee1e798-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Lock "cinder-ee4ea378-e99a-48e8-8096-b1572ee1e798-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0d10c00e-8039-4065-be24-3d3cde167398 tempest-VolumesImageMetadata-895740920 None] Lock "cinder-3d328c7f-582c-4bff-9f77-ec20b11e1278-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:00 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Acquiring lock "cinder-quobyte-ee4ea378-e99a-48e8-8096-b1572ee1e798" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:00 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Lock "cinder-quobyte-ee4ea378-e99a-48e8-8096-b1572ee1e798" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c50ab-d43c-4ab6-b3ff-3e0bef48b253]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:00 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 Apr 16 11:28:00 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:00 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.535s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Deleted volume successfully. Apr 16 11:28:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20ed41dd-51cf-4743-a95f-65f10464c947 tempest-ServersNegativeTestJSON-428526505 None] Lock "cinder-2bcca339-49d0-4853-8381-9484c13f5ef8-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:01 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798" returned: 0 in 0.602s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:01 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798 Apr 16 11:28:01 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:01 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ee4ea378-e99a-48e8-8096-b1572ee1e798" returned: 0 in 0.784s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Lock "cinder-quobyte-ee4ea378-e99a-48e8-8096-b1572ee1e798" released by "delete_volume" :: held 1.423s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Created reservations ['45ab791a-f0f2-4727-92f1-c05797a4e875', '036b7635-f2b2-4da3-bcb3-99047effab9c', 'fa3f67da-0a1e-4540-9255-f602fb5f88a0', 'df820ebf-e268-4e0c-a798-7d527cce9cb6'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=126,cinder:UPDATE=157,cinder:INSERT=41,cinder:DELETE=11 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:01 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:01 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:02 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.514s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:02 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:02 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Deleted volume successfully. Apr 16 11:28:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8e696ea7-3e36-4a2f-9419-0359e40733ac tempest-VolumesCloneNegativeTest-511280434 None] Lock "cinder-ee4ea378-e99a-48e8-8096-b1572ee1e798-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Flow 'volume_create_manager' (35e435b1-fbbf-4b05-87d1-4278b826e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d34feac-564f-4fe0-98d6-e5daa7351433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d34feac-564f-4fe0-98d6-e5daa7351433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-742190118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83d0766-94bf-4e5c-80b2-92e23fcd6666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905af105d71a4593a7dea4a251febcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:03Z,use_quota=True,user_id='ab547588c4e84ba2a9e2bd0fa26585eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9636ce2d-ccb8-4547-acb6-c06757ea0e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9636ce2d-ccb8-4547-acb6-c06757ea0e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57396ac4-4cea-49ae-8313-cc6e75fddad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57396ac4-4cea-49ae-8313-cc6e75fddad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83d0766-94bf-4e5c-80b2-92e23fcd6666', 'volume_name': 'volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9affee-5502-4041-af54-e296abed9855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9affee-5502-4041-af54-e296abed9855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1c6cea-f178-4f1d-a4a6-289dad6e1bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:03 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Volume f83d0766-94bf-4e5c-80b2-92e23fcd6666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666', 'volume_size': 1} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-742190118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83d0766-94bf-4e5c-80b2-92e23fcd6666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905af105d71a4593a7dea4a251febcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:03Z,use_quota=True,user_id='ab547588c4e84ba2a9e2bd0fa26585eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Creating volume f83d0766-94bf-4e5c-80b2-92e23fcd6666 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:03 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:03 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 1073741824 Apr 16 11:28:03 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:04 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 1073741824" returned: 0 in 0.665s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=141,cinder:SELECT=98,cinder:INSERT=44,cinder:DELETE=11 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:04 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 Apr 16 11:28:04 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:04 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666" returned: 0 in 0.542s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1c6cea-f178-4f1d-a4a6-289dad6e1bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4d2fc1-eca3-4d57-b9a9-932902b76b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:04 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Volume volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 (f83d0766-94bf-4e5c-80b2-92e23fcd6666): created successfully Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4d2fc1-eca3-4d57-b9a9-932902b76b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Flow 'volume_create_manager' (35e435b1-fbbf-4b05-87d1-4278b826e384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:04 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-db2e5f4b-233a-4493-ab1d-a022b43de605 tempest-VolumesTransfersTest-99659047 None] Created volume successfully. Apr 16 11:28:06 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a2049563-1f95-4155-82d0-5ba6e831398e tempest-VolumesTransfersTest-1684059436 None] Transfer volume completed successfully. Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Flow 'volume_create_manager' (e6808ab7-ada7-4b57-a63d-d19268e99a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeb64e3-bc8e-4155-bfe1-5f0b22aeffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeb64e3-bc8e-4155-bfe1-5f0b22aeffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-382591434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6b838d-26dc-4c84-a6c6-de916a0c08c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90eee636d0a4274bd401eacdc6d90d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:06Z,use_quota=True,user_id='283712fd5bf144adaaec3ce61e4bc69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787f01e3-7375-4515-9260-ff0aaa670406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787f01e3-7375-4515-9260-ff0aaa670406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd5ba41-f702-4c2f-9556-a817b16f9da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd5ba41-f702-4c2f-9556-a817b16f9da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6b838d-26dc-4c84-a6c6-de916a0c08c1', 'volume_name': 'volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e0ce75-184a-4910-a76d-981aa0c4f73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e0ce75-184a-4910-a76d-981aa0c4f73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b285e8-3d88-4454-be4a-dd9378f08ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Volume 9c6b838d-26dc-4c84-a6c6-de916a0c08c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1', 'volume_size': 1} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-382591434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6b838d-26dc-4c84-a6c6-de916a0c08c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90eee636d0a4274bd401eacdc6d90d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:06Z,use_quota=True,user_id='283712fd5bf144adaaec3ce61e4bc69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Creating volume 9c6b838d-26dc-4c84-a6c6-de916a0c08c1 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:06 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:06 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 1073741824 Apr 16 11:28:06 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Flow 'volume_create_manager' (2764b3a6-9c2b-447a-b2a1-d05e83d191e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bba0651-9157-41e9-bbc4-0994740f3445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bba0651-9157-41e9-bbc4-0994740f3445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-823148927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8512053d-9103-45df-9b3a-c95f7e63225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11353a3ff5d8405889b77ec70a2cb889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:07Z,use_quota=True,user_id='5c78bbe610e14cf9b18a9a49c2a422b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1321fd42-503d-4a8f-bc45-1c27d8e87823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1321fd42-503d-4a8f-bc45-1c27d8e87823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145dca2c-b511-47c0-b24f-46f8294e4197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145dca2c-b511-47c0-b24f-46f8294e4197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8512053d-9103-45df-9b3a-c95f7e63225b', 'volume_name': 'volume-8512053d-9103-45df-9b3a-c95f7e63225b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcf845c-d69b-4754-b4bf-e70091f03290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcf845c-d69b-4754-b4bf-e70091f03290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4499042f-07ca-451a-9f57-a402d7a6940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:06 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Volume 8512053d-9103-45df-9b3a-c95f7e63225b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8512053d-9103-45df-9b3a-c95f7e63225b', 'volume_size': 1} Apr 16 11:28:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:07 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 1073741824" returned: 0 in 0.523s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Acquiring lock "cinder-f83d0766-94bf-4e5c-80b2-92e23fcd6666-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Lock "cinder-f83d0766-94bf-4e5c-80b2-92e23fcd6666-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:07 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 Apr 16 11:28:07 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Acquiring lock "cinder-quobyte-f83d0766-94bf-4e5c-80b2-92e23fcd6666" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Lock "cinder-quobyte-f83d0766-94bf-4e5c-80b2-92e23fcd6666" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45cd0e6-fa69-488c-b8b7-5ebcf8e8209f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:07 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 Apr 16 11:28:07 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:07 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1" returned: 0 in 0.442s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-823148927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8512053d-9103-45df-9b3a-c95f7e63225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11353a3ff5d8405889b77ec70a2cb889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:07Z,use_quota=True,user_id='5c78bbe610e14cf9b18a9a49c2a422b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Creating volume 8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:07 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b285e8-3d88-4454-be4a-dd9378f08ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54aa4223-e500-498b-9ee8-336dbcdaf1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:07 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b 1073741824 Apr 16 11:28:07 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:07 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Volume volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 (9c6b838d-26dc-4c84-a6c6-de916a0c08c1): created successfully Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54aa4223-e500-498b-9ee8-336dbcdaf1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Flow 'volume_create_manager' (e6808ab7-ada7-4b57-a63d-d19268e99a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:07 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-72da5cd3-31de-4b32-9e47-53ec3012001f tempest-VolumesNegativeTest-1301445818 None] Created volume successfully. Apr 16 11:28:07 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:07 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666 Apr 16 11:28:07 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:08 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b 1073741824" returned: 0 in 0.523s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:08 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b Apr 16 11:28:08 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:08 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f83d0766-94bf-4e5c-80b2-92e23fcd6666" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Lock "cinder-quobyte-f83d0766-94bf-4e5c-80b2-92e23fcd6666" released by "delete_volume" :: held 0.986s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Created reservations ['af2eaa49-e108-4d6a-b47f-43415ed225cb', '0a0f0e9f-5d18-4c6a-a55c-d1fcb2a91d47', '201b2c1a-ad20-49a7-8f1a-33bffbc66b83', '969d86ea-d426-4270-8fa2-ad5331a56589'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:08 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:08 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:08 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b" returned: 0 in 0.474s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4499042f-07ca-451a-9f57-a402d7a6940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8512053d-9103-45df-9b3a-c95f7e63225b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69361b0-7f31-451d-80fa-d207d93da229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Volume volume-8512053d-9103-45df-9b3a-c95f7e63225b (8512053d-9103-45df-9b3a-c95f7e63225b): created successfully Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69361b0-7f31-451d-80fa-d207d93da229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Flow 'volume_create_manager' (2764b3a6-9c2b-447a-b2a1-d05e83d191e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-b9f7c1fd-d648-4c7e-a160-380e73af20ed req-b0753a3b-20fd-493d-b751-8aef4dbec21c tempest-VolumesSnapshotsTestJSON-1625366120 None] Created volume successfully. Apr 16 11:28:08 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.533s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Deleted volume successfully. Apr 16 11:28:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d5912fc8-bc87-4850-abba-4a5030586c68 tempest-VolumesTransfersTest-291131911 None] Lock "cinder-f83d0766-94bf-4e5c-80b2-92e23fcd6666-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Creating offline snapshot 756d647f-b591-4ace-b7a2-ac191336253f of volume 8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[634d493b-ed87-41ff-a892-df7ba1b981b7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:09 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b Apr 16 11:28:09 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Flow 'volume_create_manager' (137b5b8c-0dbe-4ccb-b535-cd6ea4a20c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e45b162-d894-431c-83f2-6d99ee25ec9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e45b162-d894-431c-83f2-6d99ee25ec9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1061205606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929928c4-b2d2-4171-a811-c30b60e524ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905af105d71a4593a7dea4a251febcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:10Z,use_quota=True,user_id='ab547588c4e84ba2a9e2bd0fa26585eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8ebdf5-3fb1-4c2f-a4d5-baf53cda7e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8ebdf5-3fb1-4c2f-a4d5-baf53cda7e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93e3cb8-1e6d-4b95-8dea-1ab0c92c4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93e3cb8-1e6d-4b95-8dea-1ab0c92c4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929928c4-b2d2-4171-a811-c30b60e524ee', 'volume_name': 'volume-929928c4-b2d2-4171-a811-c30b60e524ee', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dc9db0-e6ab-4d50-aa43-65cca483514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dc9db0-e6ab-4d50-aa43-65cca483514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa00d5-3cfb-43c1-b9a3-b2f3490ad94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:09 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Volume 929928c4-b2d2-4171-a811-c30b60e524ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929928c4-b2d2-4171-a811-c30b60e524ee', 'volume_size': 1} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:09 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b" returned: 0 in 0.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:09 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f 1G Apr 16 11:28:09 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:10 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f 1G" returned: 0 in 0.558s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8512053d-9103-45df-9b3a-c95f7e63225b -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:10 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8512053d-9103-45df-9b3a-c95f7e63225b -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f Apr 16 11:28:10 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:10 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:10 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:10 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8512053d-9103-45df-9b3a-c95f7e63225b -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f" returned: 0 in 0.573s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:10 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f is being set with open permissions: ugo+rw Apr 16 11:28:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:10 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f Apr 16 11:28:10 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:11 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.530s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:11 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:11 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.info Apr 16 11:28:11 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:12 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.info" returned: 0 in 0.491s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:12 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.info is being set with open permissions: ugo+rw Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:12 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.info Apr 16 11:28:12 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:12 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.info" returned: 0 in 0.442s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.229s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.830s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1061205606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929928c4-b2d2-4171-a811-c30b60e524ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905af105d71a4593a7dea4a251febcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:10Z,use_quota=True,user_id='ab547588c4e84ba2a9e2bd0fa26585eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Creating volume 929928c4-b2d2-4171-a811-c30b60e524ee {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:12 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:12 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee 1073741824 Apr 16 11:28:12 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:12 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-b451dd04-735d-44c9-9a9d-0540cc0d5c31 req-04613105-a4e6-4ead-af18-d451aeabde67 tempest-VolumesSnapshotsTestJSON-1625366120 None] Create snapshot completed successfully Apr 16 11:28:13 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee 1073741824" returned: 0 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:13 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee Apr 16 11:28:13 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:13 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee" returned: 0 in 0.437s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa00d5-3cfb-43c1-b9a3-b2f3490ad94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929928c4-b2d2-4171-a811-c30b60e524ee', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff4f3e0-3d36-40c3-b0d0-4977c03b1cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:13 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Volume volume-929928c4-b2d2-4171-a811-c30b60e524ee (929928c4-b2d2-4171-a811-c30b60e524ee): created successfully Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff4f3e0-3d36-40c3-b0d0-4977c03b1cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Flow 'volume_create_manager' (137b5b8c-0dbe-4ccb-b535-cd6ea4a20c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:13 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0697f561-3fe6-4d1f-9056-3d727e75ff04 tempest-VolumesTransfersTest-99659047 None] Created volume successfully. Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "cinder-756d647f-b591-4ace-b7a2-ac191336253f-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-756d647f-b591-4ace-b7a2-ac191336253f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "cinder-quobyte-8512053d-9103-45df-9b3a-c95f7e63225b" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-quobyte-8512053d-9103-45df-9b3a-c95f7e63225b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "cinder-quobyte-756d647f-b591-4ace-b7a2-ac191336253f" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-quobyte-756d647f-b591-4ace-b7a2-ac191336253f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Deleting offline snapshot 756d647f-b591-4ace-b7a2-ac191336253f of volume 8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] snapshot_file for this snap is: volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[62abce08-b9e0-4f83-ab51-5007337cfc2b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:13 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f Apr 16 11:28:13 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Acquiring lock "cinder-929928c4-b2d2-4171-a811-c30b60e524ee-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Lock "cinder-929928c4-b2d2-4171-a811-c30b60e524ee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Acquiring lock "cinder-quobyte-929928c4-b2d2-4171-a811-c30b60e524ee" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Lock "cinder-quobyte-929928c4-b2d2-4171-a811-c30b60e524ee" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9483dfad-f948-4455-9d3c-5826f04a8dd3]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:14 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee Apr 16 11:28:14 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:14 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f" returned: 0 in 0.673s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8512053d-9103-45df-9b3a-c95f7e63225b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c2384-3506-4ec4-8a03-7f53b5caafee]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:14 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b Apr 16 11:28:14 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:14 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee" returned: 0 in 0.615s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:14 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee Apr 16 11:28:14 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:15 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b" returned: 0 in 0.746s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:15 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f Apr 16 11:28:15 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:15 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-929928c4-b2d2-4171-a811-c30b60e524ee" returned: 0 in 0.611s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Lock "cinder-quobyte-929928c4-b2d2-4171-a811-c30b60e524ee" released by "delete_volume" :: held 1.252s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Created reservations ['d9bd5ce5-1cea-4b9b-bb1d-062876825e81', '03d7c93d-612e-482a-9adf-aef3907d14ef', '64aad8ef-d7e0-40f4-9856-d1edf2422321', 'b136e1ad-b883-436b-b47b-217cf6f0ac71'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:15 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:15 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:15 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f" returned: 0 in 0.643s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:15 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f Apr 16 11:28:15 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:15 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.496s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:15 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:15 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Deleted volume successfully. Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2476e99f-351e-4edd-9249-0a865cd8817b tempest-VolumesTransfersTest-291131911 None] Lock "cinder-929928c4-b2d2-4171-a811-c30b60e524ee-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:16 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b.756d647f-b591-4ace-b7a2-ac191336253f" returned: 0 in 0.479s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-quobyte-756d647f-b591-4ace-b7a2-ac191336253f" released by "_delete_snapshot" :: held 2.610s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-quobyte-8512053d-9103-45df-9b3a-c95f7e63225b" released by "delete_snapshot" :: held 2.624s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.quota [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Created reservations ['51ee5d21-5fc4-4608-b12d-354f88095904', '91e4b4f8-f7e8-4b20-b472-faa6fa81772c', 'a1fc94e8-c7e5-49ff-b653-9a814849b79a', 'f6634924-b701-4af9-9803-f44ee47845cd'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Delete snapshot completed successfully. Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-9d74e8e3-4b2e-4872-b982-8d8703514d31 req-d6829a59-a67e-4fa9-995d-154aca8ccfc3 tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-756d647f-b591-4ace-b7a2-ac191336253f-delete_snapshot" released by "delete_snapshot" :: held 2.754s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b1b84ed5-47c0-46c6-a376-5bb36c02bdad tempest-GroupsV320Test-378137185 None] Group tempest-GroupsV320Test-Group-1226191617: creating Apr 16 11:28:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b1b84ed5-47c0-46c6-a376-5bb36c02bdad tempest-GroupsV320Test-378137185 None] Group tempest-GroupsV320Test-Group-1226191617: created successfully Apr 16 11:28:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b1b84ed5-47c0-46c6-a376-5bb36c02bdad tempest-GroupsV320Test-378137185 None] Create group completed successfully. Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "cinder-8512053d-9103-45df-9b3a-c95f7e63225b-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-8512053d-9103-45df-9b3a-c95f7e63225b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "cinder-quobyte-8512053d-9103-45df-9b3a-c95f7e63225b" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-quobyte-8512053d-9103-45df-9b3a-c95f7e63225b" acquired by "delete_volume" :: waited 0.027s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83b1c5-33a8-4d1b-ae31-5963abe3e512]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:17 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b Apr 16 11:28:17 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:17 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b" returned: 0 in 0.554s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:17 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b Apr 16 11:28:17 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Created reservations ['906fd493-bd05-4759-a5dd-befff3fc98f9'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:17 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:17 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:18 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8512053d-9103-45df-9b3a-c95f7e63225b" returned: 0 in 0.575s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-quobyte-8512053d-9103-45df-9b3a-c95f7e63225b" released by "delete_volume" :: held 1.164s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG cinder.quota [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Created reservations ['7e9d59a3-1a97-41b1-b2c3-e3980bf31854', 'e56c0bf7-8929-45d8-83cc-779a66b0495c', '59005a1b-b5f8-4709-98d3-36d44bc23eb6', '6eda52e3-f1b6-4e14-bb62-2369087bbfea'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:18 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:18 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:18 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b4972973-460b-49ec-85f5-2c1e344f7841 tempest-GroupsV320Test-378137185 None] Delete group completed successfully. Apr 16 11:28:18 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG cinder.manager [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Deleted volume successfully. Apr 16 11:28:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [req-96711fcb-7ee6-49b8-8ad1-43f1f1fe5fbd req-44ebb24a-efaa-4f58-b2c5-b4a9548e8a2a tempest-VolumesSnapshotsTestJSON-1625366120 None] Lock "cinder-8512053d-9103-45df-9b3a-c95f7e63225b-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:26 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-121aae4b-52db-4099-9e9f-1ca9e043849b tempest-GroupSnapshotsTest-756277891 None] Group tempest-GroupSnapshotsTest-Group-803539697: creating Apr 16 11:28:26 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-121aae4b-52db-4099-9e9f-1ca9e043849b tempest-GroupSnapshotsTest-756277891 None] Group tempest-GroupSnapshotsTest-Group-803539697: created successfully Apr 16 11:28:26 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-121aae4b-52db-4099-9e9f-1ca9e043849b tempest-GroupSnapshotsTest-756277891 None] Create group completed successfully. Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Flow 'volume_create_manager' (2c355989-079d-47b0-9ddd-6a319187a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4d876a-1b4d-4d9d-a9ee-9b2c04a3ba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4d876a-1b4d-4d9d-a9ee-9b2c04a3ba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134802211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426e7cd7-b70f-432b-bba2-cdd058c4d112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b9f26395eb4deea775882c04b70c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:28Z,use_quota=True,user_id='c487b437ff4c481ea99c6ad6e2e3b64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3037a2ee-8a04-4534-8c5d-048f057d1007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3037a2ee-8a04-4534-8c5d-048f057d1007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f5dd17-f91e-4f18-ae82-0f378a91b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f5dd17-f91e-4f18-ae82-0f378a91b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426e7cd7-b70f-432b-bba2-cdd058c4d112', 'volume_name': 'volume-426e7cd7-b70f-432b-bba2-cdd058c4d112', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b58eda-11ff-4270-a6e7-cf919d6fcca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b58eda-11ff-4270-a6e7-cf919d6fcca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630528c2-3996-4321-9a63-d8b020a3f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:27 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Volume 426e7cd7-b70f-432b-bba2-cdd058c4d112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426e7cd7-b70f-432b-bba2-cdd058c4d112', 'volume_size': 1} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134802211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426e7cd7-b70f-432b-bba2-cdd058c4d112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b9f26395eb4deea775882c04b70c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:28Z,use_quota=True,user_id='c487b437ff4c481ea99c6ad6e2e3b64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Creating volume 426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:27 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:27 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 1073741824 Apr 16 11:28:27 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (257e7983-1210-433b-b8c8-14172ce1e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b7ab0e-58e0-4f9f-810a-8c2e466eb84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b7ab0e-58e0-4f9f-810a-8c2e466eb84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936681515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cedfb98-3b68-4e79-9cbd-36dbacdc33f5,host='devstack@QuobyteHD#QuobyteHD',id=99597915-49f0-4c5c-9de2-6b04fa566309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:28Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cc7415c-50c0-45fc-bf53-631a0f0a19cc),volume_type_id=3cc7415c-50c0-45fc-bf53-631a0f0a19cc)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4552b95a-f303-45b0-ae9a-d1b076686014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4552b95a-f303-45b0-ae9a-d1b076686014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1d548c-c155-41b4-8532-9f6598fa39e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1d548c-c155-41b4-8532-9f6598fa39e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99597915-49f0-4c5c-9de2-6b04fa566309', 'volume_name': 'volume-99597915-49f0-4c5c-9de2-6b04fa566309', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed7be5d-6cde-47bf-b569-710641fc65e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed7be5d-6cde-47bf-b569-710641fc65e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494d986e-f866-47c9-861b-77bc5ba0eade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:28 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Volume 99597915-49f0-4c5c-9de2-6b04fa566309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99597915-49f0-4c5c-9de2-6b04fa566309', 'volume_size': 1} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:28 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 1073741824" returned: 0 in 0.599s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:28 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:28:28 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:29 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8cedfb98-3b68-4e79-9cbd-36dbacdc33f5,created_at=2026-04-16T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936681515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cedfb98-3b68-4e79-9cbd-36dbacdc33f5,host='devstack@QuobyteHD#QuobyteHD',id=99597915-49f0-4c5c-9de2-6b04fa566309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:28Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cc7415c-50c0-45fc-bf53-631a0f0a19cc),volume_type_id=3cc7415c-50c0-45fc-bf53-631a0f0a19cc)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Creating volume 99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:29 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:29 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 1073741824 Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630528c2-3996-4321-9a63-d8b020a3f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426e7cd7-b70f-432b-bba2-cdd058c4d112', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:29 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361ab7db-1cb8-48ce-a1ce-8c107b9de7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:29 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Volume volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 (426e7cd7-b70f-432b-bba2-cdd058c4d112): created successfully Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361ab7db-1cb8-48ce-a1ce-8c107b9de7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Flow 'volume_create_manager' (2c355989-079d-47b0-9ddd-6a319187a295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:29 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0c5d62d0-c7fb-48f9-bb41-60925140a7a1 tempest-VolumesActionsTest-1421715999 None] Created volume successfully. Apr 16 11:28:29 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 1073741824" returned: 0 in 0.572s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:29 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 Apr 16 11:28:29 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:30 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309" returned: 0 in 0.520s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494d986e-f866-47c9-861b-77bc5ba0eade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99597915-49f0-4c5c-9de2-6b04fa566309', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06919b00-751b-4a37-b5a3-e2d0ccd12db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:30 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Volume volume-99597915-49f0-4c5c-9de2-6b04fa566309 (99597915-49f0-4c5c-9de2-6b04fa566309): created successfully Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06919b00-751b-4a37-b5a3-e2d0ccd12db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (257e7983-1210-433b-b8c8-14172ce1e42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bd79d117-bff9-4aae-953d-1f0e1900afe1 tempest-GroupSnapshotsTest-756277891 None] Created volume successfully. Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Flow 'volume_create_manager' (d4053f43-d998-4f65-ab5f-cde2e94f3a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883b39b7-2a19-4e57-bef4-fbf80f3d3a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883b39b7-2a19-4e57-bef4-fbf80f3d3a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-923110530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da4249c-4018-4012-ae0c-7552e2a62073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e43b9c6eff4f9db4270cb5300a651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:31Z,use_quota=True,user_id='60c1f6e6c7214055ac4b429dc8a90754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0879ca2-2268-4993-9a89-3c62febf6b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0879ca2-2268-4993-9a89-3c62febf6b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ace89a-6320-4b44-b301-94a8c100404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ace89a-6320-4b44-b301-94a8c100404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da4249c-4018-4012-ae0c-7552e2a62073', 'volume_name': 'volume-5da4249c-4018-4012-ae0c-7552e2a62073', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0431b1cd-d68a-48c9-935b-efc88e9b30ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0431b1cd-d68a-48c9-935b-efc88e9b30ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d753e8f1-e699-454e-a337-cd134358a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:30 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Volume 5da4249c-4018-4012-ae0c-7552e2a62073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da4249c-4018-4012-ae0c-7552e2a62073', 'volume_size': 1} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-923110530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da4249c-4018-4012-ae0c-7552e2a62073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e43b9c6eff4f9db4270cb5300a651f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:31Z,use_quota=True,user_id='60c1f6e6c7214055ac4b429dc8a90754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Creating volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:30 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:30 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 1073741824 Apr 16 11:28:30 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] GroupSnapshot 78ece7d5-d094-4e3d-a788-c3f087f8244a: creating. Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Group snapshot 78ece7d5-d094-4e3d-a788-c3f087f8244a: creating. {{(pid=83804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 11:28:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:31 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 1073741824" returned: 0 in 0.559s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:31 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 Apr 16 11:28:31 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:31 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.946s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d753e8f1-e699-454e-a337-cd134358a164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da4249c-4018-4012-ae0c-7552e2a62073', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835f1abf-a4db-496b-b154-cb61d43d8eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Creating offline snapshot e38c1982-6442-472c-94d1-547120618c7b of volume 99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:28:31 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Volume volume-5da4249c-4018-4012-ae0c-7552e2a62073 (5da4249c-4018-4012-ae0c-7552e2a62073): created successfully Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835f1abf-a4db-496b-b154-cb61d43d8eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Flow 'volume_create_manager' (d4053f43-d998-4f65-ab5f-cde2e94f3a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1234dba9-029a-4dc6-b6cc-c4bcd43d9561]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:31 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e762843d-11b4-43ac-95a9-64285a55ead5 tempest-SnapshotsActionsTest-204488925 None] Created volume successfully. Apr 16 11:28:31 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 Apr 16 11:28:31 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:32 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309" returned: 0 in 0.532s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:32 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b 1G Apr 16 11:28:32 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:32 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b 1G" returned: 0 in 0.568s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99597915-49f0-4c5c-9de2-6b04fa566309 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:32 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99597915-49f0-4c5c-9de2-6b04fa566309 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b Apr 16 11:28:32 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:33 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99597915-49f0-4c5c-9de2-6b04fa566309 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b" returned: 0 in 0.479s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:33 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:28:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:33 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b Apr 16 11:28:33 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:33 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b" returned: 0 in 0.427s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:33 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.info Apr 16 11:28:33 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:34 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.info" returned: 0 in 0.476s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:34 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:34 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.info Apr 16 11:28:34 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:34 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.info" returned: 0 in 0.541s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.097s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.935s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Creating offline snapshot e729e03e-0de0-4762-bdf4-708cb4f2514f of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[83adf1f3-9724-4445-b128-94074e2d3575]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:34 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 Apr 16 11:28:34 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:34 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ed280403-b499-4669-a746-9de08adaf713 tempest-GroupSnapshotsTest-756277891 None] group_snapshot 78ece7d5-d094-4e3d-a788-c3f087f8244a: created successfully Apr 16 11:28:35 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073" returned: 0 in 0.630s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:35 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f 1G Apr 16 11:28:35 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Acquiring lock "cinder-9c6b838d-26dc-4c84-a6c6-de916a0c08c1-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Lock "cinder-9c6b838d-26dc-4c84-a6c6-de916a0c08c1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Acquiring lock "cinder-quobyte-9c6b838d-26dc-4c84-a6c6-de916a0c08c1" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Lock "cinder-quobyte-9c6b838d-26dc-4c84-a6c6-de916a0c08c1" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[deccc016-1766-4e3a-965b-d9a222d8578b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:35 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 Apr 16 11:28:35 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:36 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f 1G" returned: 0 in 0.562s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:36 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:28:36 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:36 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1" returned: 0 in 0.576s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:36 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1 Apr 16 11:28:36 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:36 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:36 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f is being set with open permissions: ugo+rw Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:36 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:28:36 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:36 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9c6b838d-26dc-4c84-a6c6-de916a0c08c1" returned: 0 in 0.442s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Lock "cinder-quobyte-9c6b838d-26dc-4c84-a6c6-de916a0c08c1" released by "delete_volume" :: held 1.040s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Created reservations ['b022dd43-3403-45ff-b772-a09f0a9f2e99', '9131a44f-46b8-4b64-a04d-e0a045aab329', '3e546cda-f0f6-485f-a9c3-7277d96b2080', 'fe13bea8-a51c-4771-b9fd-66b0e01329bb'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:36 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:36 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:37 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.534s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:37 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.info Apr 16 11:28:37 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:37 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.458s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:37 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:37 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Deleted volume successfully. Apr 16 11:28:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9344edfc-160c-4457-8393-d32f7af7941b tempest-VolumesNegativeTest-1301445818 None] Lock "cinder-9c6b838d-26dc-4c84-a6c6-de916a0c08c1-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:37 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.info" returned: 0 in 0.443s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:37 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.info is being set with open permissions: ugo+rw Apr 16 11:28:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:37 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.info Apr 16 11:28:37 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:38 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.info" returned: 0 in 0.448s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.242s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.155s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-e38c1982-6442-472c-94d1-547120618c7b-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-e38c1982-6442-472c-94d1-547120618c7b-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Creating volume cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 from snapshot e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:38 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5d725927-0e5f-4911-b454-d5bfb4a7683b tempest-SnapshotsActionsTest-204488925 None] Create snapshot completed successfully Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] snapshot: e38c1982-6442-472c-94d1-547120618c7b, volume: cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91cf961-1908-4ddf-95bd-29dd1af78bf0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:38 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b Apr 16 11:28:38 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:38 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b" returned: 0 in 0.562s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99597915-49f0-4c5c-9de2-6b04fa566309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a977a97b-8dda-4bc6-8da5-418a94cde186]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:38 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 Apr 16 11:28:38 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (e6355f95-b9a1-40a3-be33-cce9b8b34c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbb69ad-f230-44b2-b1a2-e04bdb51e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:39 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbb69ad-f230-44b2-b1a2-e04bdb51e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774297293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacf5233-bccc-4985-a899-d28fbcd2532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:39Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dc4bc8-d566-4c57-bce2-ed7ee49b0dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dc4bc8-d566-4c57-bce2-ed7ee49b0dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd5724d-a30f-42cd-a5cf-986dadcc03b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd5724d-a30f-42cd-a5cf-986dadcc03b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacf5233-bccc-4985-a899-d28fbcd2532b', 'volume_name': 'volume-eacf5233-bccc-4985-a899-d28fbcd2532b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcbae7a-55e5-4232-8ad4-be54593114ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcbae7a-55e5-4232-8ad4-be54593114ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f81a5c3-7189-42b2-8ce7-c0b4b077df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:39 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume eacf5233-bccc-4985-a899-d28fbcd2532b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacf5233-bccc-4985-a899-d28fbcd2532b', 'volume_size': 1} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309" returned: 0 in 0.577s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:39 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 Apr 16 11:28:39 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:41 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" returned: 0 in 2.370s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:41 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef19e36-4e5b-4210-82a0-0ed94b8736f8]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:41 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 Apr 16 11:28:41 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:42 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309" returned: 0 in 0.642s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:28:42 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Converted 1024.00 MB image at 431.91 MB/s Apr 16 11:28:42 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:42 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 Apr 16 11:28:42 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:42 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" released by "_copy_volume_from_snapshot" :: held 4.694s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-e38c1982-6442-472c-94d1-547120618c7b-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" released by "_create_volume_from_snapshot" :: held 4.712s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.731s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.522s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774297293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacf5233-bccc-4985-a899-d28fbcd2532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:39Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Creating volume eacf5233-bccc-4985-a899-d28fbcd2532b {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:42 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:42 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b 1073741824 Apr 16 11:28:42 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:42 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e85fc47b-4b92-4ed5-b9f4-a958e7849bf3 tempest-GroupSnapshotsTest-756277891 None] Create group from source-snapshot-78ece7d5-d094-4e3d-a788-c3f087f8244a completed successfully. Apr 16 11:28:43 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b 1073741824" returned: 0 in 0.520s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:43 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b Apr 16 11:28:43 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:43 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b" returned: 0 in 0.515s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.360s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Creating offline snapshot 163f185d-07f0-4bd1-b35e-df4f969a004e of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:28:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f81a5c3-7189-42b2-8ce7-c0b4b077df7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacf5233-bccc-4985-a899-d28fbcd2532b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8984c2b-0ee8-4f5a-a325-0e1d98e30311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d72afcb-89f7-4f83-816a-a94acc968333]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:44 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume volume-eacf5233-bccc-4985-a899-d28fbcd2532b (eacf5233-bccc-4985-a899-d28fbcd2532b): created successfully Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8984c2b-0ee8-4f5a-a325-0e1d98e30311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (e6355f95-b9a1-40a3-be33-cce9b8b34c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-39701b3c-ea87-4a11-987a-f5aef54c989b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created volume successfully. Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e4c7bf62-ce00-492b-ad7f-2ed06b682cb7 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112" by "attach_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e4c7bf62-ce00-492b-ad7f-2ed06b682cb7 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112" acquired by "attach_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:44 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:28:44 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e4c7bf62-ce00-492b-ad7f-2ed06b682cb7 tempest-VolumesActionsTest-1421715999 None] Attaching volume 426e7cd7-b70f-432b-bba2-cdd058c4d112 to instance f829448e-9759-4f23-9d8c-1d0ea96f1e70 at mountpoint /dev/vdb on host None. Apr 16 11:28:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e4c7bf62-ce00-492b-ad7f-2ed06b682cb7 tempest-VolumesActionsTest-1421715999 None] Attach volume completed successfully. Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e4c7bf62-ce00-492b-ad7f-2ed06b682cb7 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112" released by "attach_volume" :: held 0.079s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05711f-5e50-431c-a6df-5b7971dee3ac]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:44 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 Apr 16 11:28:44 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:44 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.598s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:44 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e 1G Apr 16 11:28:44 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c76edd3-3425-483a-be12-028f63f21c0a tempest-VolumesActionsTest-1421715999 None] Acquiring lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-detach_volume" by "detach_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c76edd3-3425-483a-be12-028f63f21c0a tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8c76edd3-3425-483a-be12-028f63f21c0a tempest-VolumesActionsTest-1421715999 None] Detaching volume 426e7cd7-b70f-432b-bba2-cdd058c4d112 from instance f829448e-9759-4f23-9d8c-1d0ea96f1e70. Apr 16 11:28:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8c76edd3-3425-483a-be12-028f63f21c0a tempest-VolumesActionsTest-1421715999 None] Detach volume completed successfully. Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8c76edd3-3425-483a-be12-028f63f21c0a tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:44 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" returned: 0 in 0.579s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:44 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6 Apr 16 11:28:44 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (2219939c-4c75-485d-9d9a-819f76845a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c032856-fe59-4b3d-859b-87539508623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c032856-fe59-4b3d-859b-87539508623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817797747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c9bb9e-11fb-46d1-96ee-dd79a6133c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:45Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5026d0ab-b3ab-4890-914d-7f7248669a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5026d0ab-b3ab-4890-914d-7f7248669a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0efc95-4b5f-49dd-a1b1-f72da7377942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0efc95-4b5f-49dd-a1b1-f72da7377942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c9bb9e-11fb-46d1-96ee-dd79a6133c22', 'volume_name': 'volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de66432-c7b3-45ae-9dfc-6bd32fb93e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de66432-c7b3-45ae-9dfc-6bd32fb93e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975c1ca7-17c0-4b1b-a971-ffcf90d4d687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume 26c9bb9e-11fb-46d1-96ee-dd79a6133c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22', 'volume_size': 1} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (824fd8d9-5f9e-4fb8-b4af-40a123f34dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519d9abb-647f-46c4-b848-c530b5e0a0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519d9abb-647f-46c4-b848-c530b5e0a0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846161014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2e1610-df93-48b9-891f-528bc7ec7756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:45Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d9cc0e-5f05-4944-9204-966129f05554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d9cc0e-5f05-4944-9204-966129f05554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb30697-cbed-4f20-ab89-4ed5cd40fc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb30697-cbed-4f20-ab89-4ed5cd40fc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2e1610-df93-48b9-891f-528bc7ec7756', 'volume_name': 'volume-9b2e1610-df93-48b9-891f-528bc7ec7756', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461e9722-8222-4c82-a298-a4f8e4c04b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461e9722-8222-4c82-a298-a4f8e4c04b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405e7b1d-cec3-4fb0-bb74-74c68617dbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume 9b2e1610-df93-48b9-891f-528bc7ec7756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2e1610-df93-48b9-891f-528bc7ec7756', 'volume_size': 1} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:45 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e 1G" returned: 0 in 0.785s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:45 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e Apr 16 11:28:45 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (ef19b910-eb4d-4cbc-8fea-1f6c9d019ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273da030-e644-4541-8be3-00b92c62e3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273da030-e644-4541-8be3-00b92c62e3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161838386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5259fd46-0fbb-4e16-b7b7-aae227eb5939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:45Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d993ed-97ec-41e8-b49b-7ec44b506d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d993ed-97ec-41e8-b49b-7ec44b506d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3069205f-1eb0-4b2a-969e-dfd65f548224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3069205f-1eb0-4b2a-969e-dfd65f548224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5259fd46-0fbb-4e16-b7b7-aae227eb5939', 'volume_name': 'volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dceba46-9274-4ee2-abdd-a46cd3ba9aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dceba46-9274-4ee2-abdd-a46cd3ba9aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66165265-69ce-4847-81c0-8cb7264094a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume 5259fd46-0fbb-4e16-b7b7-aae227eb5939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939', 'volume_size': 1} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" returned: 0 in 0.969s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-cdd6ce32-d3ea-4cdd-bb1b-aec527e63df6" released by "delete_volume" :: held 1.594s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (48767e9b-44a6-4d9e-ad3a-1f36e3579b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed34bc2-0f49-4924-b9c4-b440cfd6c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed34bc2-0f49-4924-b9c4-b440cfd6c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759687253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c78c75-0227-4ce7-9102-edd556555555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:46Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc83e60-a759-4afc-b022-8599a1e20991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc83e60-a759-4afc-b022-8599a1e20991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f49914-f3de-4858-87ce-2e351a88d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f49914-f3de-4858-87ce-2e351a88d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c78c75-0227-4ce7-9102-edd556555555', 'volume_name': 'volume-73c78c75-0227-4ce7-9102-edd556555555', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a39c12-e704-4c9e-afc1-06c7c06889e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a39c12-e704-4c9e-afc1-06c7c06889e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c248872-f58e-4320-9fe6-ec3e898c5a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume 73c78c75-0227-4ce7-9102-edd556555555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c78c75-0227-4ce7-9102-edd556555555', 'volume_size': 1} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Created reservations ['1da37c0e-1fa4-4e7b-be80-747da4680738'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:45 devstack cinder-volume[83804]: WARNING cinder.quota [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-275021857 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-275021857, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:28:45 devstack cinder-volume[83804]: WARNING cinder.quota [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-275021857 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-275021857, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:28:45 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Created reservations ['549ec4a2-e8a3-453b-aa06-01d35b0cae98', '86164440-e79d-4852-b147-1834e3a90f95', 'ca5b9821-0022-4dde-ac3f-187692b43fbd', '8e5d5cf2-a6a9-42f2-83c4-9a72236a847a'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:46 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:46 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (3bc357d0-4b8a-4ced-b0ef-a6d7626ee84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3762fb06-e088-41a6-9122-809ab31f5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3762fb06-e088-41a6-9122-809ab31f5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636382400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6cdceb-ba9b-4333-993b-68ecc3544192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:46Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b83229b-b778-4871-b473-12a6af22b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b83229b-b778-4871-b473-12a6af22b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b996ce9-7dd8-4755-9e3a-4e1065bd2bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b996ce9-7dd8-4755-9e3a-4e1065bd2bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6cdceb-ba9b-4333-993b-68ecc3544192', 'volume_name': 'volume-3d6cdceb-ba9b-4333-993b-68ecc3544192', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc149098-2086-47f1-b75a-4ee058012da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc149098-2086-47f1-b75a-4ee058012da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca73d77-bbf8-4f47-8242-40494f301239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:46 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume 3d6cdceb-ba9b-4333-993b-68ecc3544192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6cdceb-ba9b-4333-993b-68ecc3544192', 'volume_size': 1} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:46 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e" returned: 0 in 0.800s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:46 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e is being set with open permissions: ugo+rw Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:46 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e Apr 16 11:28:46 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] group_snapshot 78ece7d5-d094-4e3d-a788-c3f087f8244a: deleting Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] group_snapshot 78ece7d5-d094-4e3d-a788-c3f087f8244a: deleting {{(pid=83804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 11:28:46 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-99597915-49f0-4c5c-9de2-6b04fa566309" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-3fa9503b-7206-4bab-b37f-e139b060cede tempest-GroupSnapshotsTest-756277891 None] Delete group completed successfully. Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-99597915-49f0-4c5c-9de2-6b04fa566309" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-e38c1982-6442-472c-94d1-547120618c7b" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-e38c1982-6442-472c-94d1-547120618c7b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Deleting offline snapshot e38c1982-6442-472c-94d1-547120618c7b of volume 99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] snapshot_file for this snap is: volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca929a-f053-41c2-bf70-55af5610f23c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:46 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:46 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b Apr 16 11:28:46 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817797747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c9bb9e-11fb-46d1-96ee-dd79a6133c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:45Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Creating volume 26c9bb9e-11fb-46d1-96ee-dd79a6133c22 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:46 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:46 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 1073741824 Apr 16 11:28:46 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5e49694c-f3e0-438c-a473-fac61c1f9b2e tempest-SnapshotsActionsTest-204488925 None] Create snapshot completed successfully Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-163f185d-07f0-4bd1-b35e-df4f969a004e-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-163f185d-07f0-4bd1-b35e-df4f969a004e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-163f185d-07f0-4bd1-b35e-df4f969a004e" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-163f185d-07f0-4bd1-b35e-df4f969a004e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Deleting offline snapshot 163f185d-07f0-4bd1-b35e-df4f969a004e of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] snapshot_file for this snap is: volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[781216f8-1e9d-41e5-aa83-330a6c1a014e]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:47 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e Apr 16 11:28:47 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:47 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b" returned: 0 in 0.604s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99597915-49f0-4c5c-9de2-6b04fa566309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c85dd5d-0034-4e7f-b178-c461cd84b87d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:47 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 Apr 16 11:28:47 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:47 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 1073741824" returned: 0 in 0.658s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:47 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 Apr 16 11:28:47 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:47 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e" returned: 0 in 0.491s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d29af-4cfb-4253-bbb7-47c70c415d16]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:47 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:28:47 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:47 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:47 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b Apr 16 11:28:47 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:47 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22" returned: 0 in 0.437s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.639s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846161014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2e1610-df93-48b9-891f-528bc7ec7756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:45Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Creating volume 9b2e1610-df93-48b9-891f-528bc7ec7756 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:47 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975c1ca7-17c0-4b1b-a971-ffcf90d4d687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bf6178-3cac-48a3-aa84-7474128dc025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:47 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 1073741824 Apr 16 11:28:47 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:47 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 (26c9bb9e-11fb-46d1-96ee-dd79a6133c22): created successfully Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bf6178-3cac-48a3-aa84-7474128dc025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (2219939c-4c75-485d-9d9a-819f76845a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0e24fb07-0cc7-470d-a490-d83f6f0f44fa tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created volume successfully. Apr 16 11:28:48 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.641s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:48 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e Apr 16 11:28:48 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:48 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b" returned: 0 in 0.592s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:48 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b Apr 16 11:28:48 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:48 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 1073741824" returned: 0 in 0.644s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:48 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 Apr 16 11:28:48 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:48 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e" returned: 0 in 0.523s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:48 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309.e38c1982-6442-472c-94d1-547120618c7b" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:48 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e Apr 16 11:28:48 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-e38c1982-6442-472c-94d1-547120618c7b" released by "_delete_snapshot" :: held 2.252s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-99597915-49f0-4c5c-9de2-6b04fa566309" released by "delete_snapshot" :: held 2.274s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:48 devstack cinder-volume[83804]: WARNING cinder.quota [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-275021857 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-275021857, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['63e67b81-b52c-4bdb-89e7-4f6922d6132d', '0ffa4e2b-5039-41d9-b1ea-93b57c49caf4', 'f8d63750-ec2c-47a0-9f4e-29377a4bf9a8', '381eb0ba-a940-4756-8ea3-a544e92997f3'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:48 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2565d8bb-6bf8-4135-83ac-caaa4baebb54 tempest-GroupSnapshotsTest-756277891 None] group_snapshot 78ece7d5-d094-4e3d-a788-c3f087f8244a: deleted successfully Apr 16 11:28:48 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756" returned: 0 in 0.432s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161838386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5259fd46-0fbb-4e16-b7b7-aae227eb5939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:45Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Creating volume 5259fd46-0fbb-4e16-b7b7-aae227eb5939 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:48 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405e7b1d-cec3-4fb0-bb74-74c68617dbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2e1610-df93-48b9-891f-528bc7ec7756', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:49 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 1073741824 Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cf5988-0b99-4d38-add2-5acfbdd497ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:49 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:49 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume volume-9b2e1610-df93-48b9-891f-528bc7ec7756 (9b2e1610-df93-48b9-891f-528bc7ec7756): created successfully Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cf5988-0b99-4d38-add2-5acfbdd497ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (824fd8d9-5f9e-4fb8-b4af-40a123f34dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:49 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f361588c-d91b-4aed-b789-0be90294a43a tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created volume successfully. Apr 16 11:28:49 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.163f185d-07f0-4bd1-b35e-df4f969a004e" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-163f185d-07f0-4bd1-b35e-df4f969a004e" released by "_delete_snapshot" :: held 2.193s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" released by "delete_snapshot" :: held 2.208s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Created reservations ['af3b9f39-db64-4891-9c2e-72d673bdcbb5', '9298b83d-5493-479b-aeea-d192c60fe918', '18eea560-4ae1-4306-8bf1-1e0ca1b4060f', '794fa14a-efb1-4224-8dc3-04c858a4c7e2'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:49 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Delete snapshot completed successfully. Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-19d8fe1d-9e84-4b3b-9881-f60ebe7e7447 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-163f185d-07f0-4bd1-b35e-df4f969a004e-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:49 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 1073741824" returned: 0 in 0.543s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:49 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 Apr 16 11:28:49 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-99597915-49f0-4c5c-9de2-6b04fa566309" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-99597915-49f0-4c5c-9de2-6b04fa566309" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7113e673-7db7-4e11-ae90-d1b3822dd450]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:49 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.079s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759687253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c78c75-0227-4ce7-9102-edd556555555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:46Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Creating volume 73c78c75-0227-4ce7-9102-edd556555555 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:50 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:50 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 Apr 16 11:28:50 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66165265-69ce-4847-81c0-8cb7264094a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:50 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 1073741824 Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffee27f-4bac-49e0-aa5a-eb12b2820dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:50 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 (5259fd46-0fbb-4e16-b7b7-aae227eb5939): created successfully Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffee27f-4bac-49e0-aa5a-eb12b2820dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (ef19b910-eb4d-4cbc-8fea-1f6c9d019ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:50 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-04069418-cd03-4d8e-aa15-57220c33cfef tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created volume successfully. Apr 16 11:28:50 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309" returned: 0 in 0.588s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:50 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309 Apr 16 11:28:50 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:50 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 1073741824" returned: 0 in 0.575s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:50 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 Apr 16 11:28:50 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:50 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-99597915-49f0-4c5c-9de2-6b04fa566309" returned: 0 in 0.451s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:50 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-99597915-49f0-4c5c-9de2-6b04fa566309" released by "delete_volume" :: held 1.083s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Created reservations ['e41932b0-e4d5-45dd-a998-ecd097d4dfa6'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:51 devstack cinder-volume[83804]: WARNING cinder.db.sqlalchemy.api [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-275021857'] Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Created reservations ['fc3ab62a-61b3-4a06-8307-895bc887191e', 'c84c6e23-4655-480b-ad66-11aba271d9b2', 'cb458a18-dd41-403c-9db8-d74fb600685d', '508bea2b-9c44-41cc-9ad6-cbd622bb36e2'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:51 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555" returned: 0 in 0.482s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.923s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636382400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6cdceb-ba9b-4333-993b-68ecc3544192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ce5a5844d4b2591b39602be952d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:46Z,use_quota=True,user_id='4eb866fb167d41d8b4c6091bedc58f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Creating volume 3d6cdceb-ba9b-4333-993b-68ecc3544192 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:51 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:51 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 1073741824 Apr 16 11:28:51 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c248872-f58e-4320-9fe6-ec3e898c5a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c78c75-0227-4ce7-9102-edd556555555', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51875e4d-5b09-49fe-9d2c-d14bc44cb663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume volume-73c78c75-0227-4ce7-9102-edd556555555 (73c78c75-0227-4ce7-9102-edd556555555): created successfully Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51875e4d-5b09-49fe-9d2c-d14bc44cb663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (48767e9b-44a6-4d9e-ad3a-1f36e3579b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:51 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b8ee3827-2f14-4143-b934-1daee6102afd tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created volume successfully. Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:51 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:51 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:51 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 1073741824" returned: 0 in 0.576s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:51 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:51 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ff802972-698e-44cb-9ffd-63fc863545af tempest-GroupSnapshotsTest-756277891 None] Delete group completed successfully. Apr 16 11:28:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:51 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 Apr 16 11:28:51 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:52 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.605s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca73d77-bbf8-4f47-8242-40494f301239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6cdceb-ba9b-4333-993b-68ecc3544192', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432a227a-17aa-45eb-b464-f3ea23ee2a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Creating offline snapshot d19ce4a2-2487-474c-ace8-cbb468927639 of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:28:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Volume volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 (3d6cdceb-ba9b-4333-993b-68ecc3544192): created successfully Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432a227a-17aa-45eb-b464-f3ea23ee2a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Flow 'volume_create_manager' (3bc357d0-4b8a-4ced-b0ef-a6d7626ee84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddcd569-63a7-4f59-89dc-d67ba9983075]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4ebf88f2-3fd6-4e2a-833e-c4f268e704ab tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created volume successfully. Apr 16 11:28:52 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:28:52 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-16de07cd-f76c-483f-b2f4-3911c3c08c27 tempest-GroupSnapshotsTest-756277891 None] Group tempest-GroupSnapshotsTest-Group-1770687236: creating Apr 16 11:28:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-16de07cd-f76c-483f-b2f4-3911c3c08c27 tempest-GroupSnapshotsTest-756277891 None] Group tempest-GroupSnapshotsTest-Group-1770687236: created successfully Apr 16 11:28:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-16de07cd-f76c-483f-b2f4-3911c3c08c27 tempest-GroupSnapshotsTest-756277891 None] Create group completed successfully. Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-3d6cdceb-ba9b-4333-993b-68ecc3544192-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-3d6cdceb-ba9b-4333-993b-68ecc3544192-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:52 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.550s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-quobyte-3d6cdceb-ba9b-4333-993b-68ecc3544192" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-3d6cdceb-ba9b-4333-993b-68ecc3544192" acquired by "delete_volume" :: waited 0.021s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:52 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 1G Apr 16 11:28:52 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee67a9d8-8f97-4c09-b5ae-bfda44090a8c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:52 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 Apr 16 11:28:52 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:53 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 1G" returned: 0 in 0.560s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:53 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 Apr 16 11:28:53 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:53 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192" returned: 0 in 0.607s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:53 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192 Apr 16 11:28:53 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (3c369548-bd9d-4573-b8b5-057dbb565ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f6f4c9-4e47-43f5-b502-e18270508bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f6f4c9-4e47-43f5-b502-e18270508bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2006376034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e053fbe-6792-4785-8945-ca093414337a,host='devstack@QuobyteHD#QuobyteHD',id=4cda3e49-e843-4688-9a8b-7e039275f0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:54Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29f6a0d8-ca2e-4cd3-8300-7001bbabbaea),volume_type_id=29f6a0d8-ca2e-4cd3-8300-7001bbabbaea)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1baf536-1844-4622-a1b7-bc57d5e1c48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1baf536-1844-4622-a1b7-bc57d5e1c48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c47d73-fb41-4883-afd8-e6f681437a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c47d73-fb41-4883-afd8-e6f681437a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cda3e49-e843-4688-9a8b-7e039275f0da', 'volume_name': 'volume-4cda3e49-e843-4688-9a8b-7e039275f0da', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752e27ce-4c78-4c5c-8397-e3d362bcdc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752e27ce-4c78-4c5c-8397-e3d362bcdc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d1fef2-8d13-4877-a0f5-cf4d06555112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:53 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Volume 4cda3e49-e843-4688-9a8b-7e039275f0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cda3e49-e843-4688-9a8b-7e039275f0da', 'volume_size': 1} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:53 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3d6cdceb-ba9b-4333-993b-68ecc3544192" returned: 0 in 0.437s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-3d6cdceb-ba9b-4333-993b-68ecc3544192" released by "delete_volume" :: held 1.085s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:53 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639" returned: 0 in 0.570s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:53 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 is being set with open permissions: ugo+rw Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created reservations ['e876224b-ae7c-4cb8-ac4a-390b7c2b0d20', '8581db13-eb58-4cfd-ae51-ce1232b4a316', '37d26ee9-972d-4043-8cae-af673b2ed2ad', '67429449-726e-4668-9621-58e1fc3224ff'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:53 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 Apr 16 11:28:53 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:53 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:53 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:54 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639" returned: 0 in 0.421s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.614s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e053fbe-6792-4785-8945-ca093414337a,created_at=2026-04-16T09:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2006376034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e053fbe-6792-4785-8945-ca093414337a,host='devstack@QuobyteHD#QuobyteHD',id=4cda3e49-e843-4688-9a8b-7e039275f0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:54Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29f6a0d8-ca2e-4cd3-8300-7001bbabbaea),volume_type_id=29f6a0d8-ca2e-4cd3-8300-7001bbabbaea)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Creating volume 4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:54 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:54 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da 1073741824 Apr 16 11:28:54 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f7b137cd-841b-4aef-b192-5ef12d3c1733 tempest-SnapshotsActionsTest-204488925 None] Create snapshot completed successfully Apr 16 11:28:54 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.429s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Deleted volume successfully. Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5a3da46f-9166-41be-959d-ac9e5401cd4e tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-3d6cdceb-ba9b-4333-993b-68ecc3544192-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-d19ce4a2-2487-474c-ace8-cbb468927639-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-d19ce4a2-2487-474c-ace8-cbb468927639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-d19ce4a2-2487-474c-ace8-cbb468927639" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-d19ce4a2-2487-474c-ace8-cbb468927639" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Deleting offline snapshot d19ce4a2-2487-474c-ace8-cbb468927639 of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] snapshot_file for this snap is: volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a486fa76-64f4-47c7-9923-177b5df99807]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:54 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 Apr 16 11:28:54 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:54 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-73c78c75-0227-4ce7-9102-edd556555555-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da 1073741824" returned: 0 in 0.608s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-73c78c75-0227-4ce7-9102-edd556555555-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:55 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da Apr 16 11:28:55 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-quobyte-73c78c75-0227-4ce7-9102-edd556555555" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-73c78c75-0227-4ce7-9102-edd556555555" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f037e69-2667-4179-9ab1-bf7e7473796b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:55 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 Apr 16 11:28:55 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:55 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639" returned: 0 in 0.523s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f18510-aec2-45ee-9a90-b2ddd53282c0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:55 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da" returned: 0 in 0.414s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d1fef2-8d13-4877-a0f5-cf4d06555112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cda3e49-e843-4688-9a8b-7e039275f0da', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9232a9ae-ceeb-4a15-a91a-8d26b1e05457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:55 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Volume volume-4cda3e49-e843-4688-9a8b-7e039275f0da (4cda3e49-e843-4688-9a8b-7e039275f0da): created successfully Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9232a9ae-ceeb-4a15-a91a-8d26b1e05457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:55 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:28:55 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (3c369548-bd9d-4573-b8b5-057dbb565ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:55 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-62f27707-642f-4657-b578-6f55d95f22b9 tempest-GroupSnapshotsTest-756277891 None] Created volume successfully. Apr 16 11:28:55 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555" returned: 0 in 0.555s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:55 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555 Apr 16 11:28:55 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:55 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:55 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 Apr 16 11:28:55 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:56 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-73c78c75-0227-4ce7-9102-edd556555555" returned: 0 in 0.548s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-73c78c75-0227-4ce7-9102-edd556555555" released by "delete_volume" :: held 1.133s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (1f1abd07-8b38-43fd-b1a9-303c52aa7280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c7c4cb-e0d9-486d-b673-a26b51ca9528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c7c4cb-e0d9-486d-b673-a26b51ca9528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880338903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e053fbe-6792-4785-8945-ca093414337a,host='devstack@QuobyteHD#QuobyteHD',id=15a409ae-4c87-4dc8-bc3d-69896f3fc0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:56Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29f6a0d8-ca2e-4cd3-8300-7001bbabbaea),volume_type_id=29f6a0d8-ca2e-4cd3-8300-7001bbabbaea)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5821c9-f14b-4c0c-a4aa-aa14d0ab34d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5821c9-f14b-4c0c-a4aa-aa14d0ab34d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e49809-da0e-4cff-b6d0-b18a39db9012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e49809-da0e-4cff-b6d0-b18a39db9012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a409ae-4c87-4dc8-bc3d-69896f3fc0cb', 'volume_name': 'volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c54c9d-bfc1-4cba-b418-30a638d1d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c54c9d-bfc1-4cba-b418-30a638d1d16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fcef5f-8e7f-4dfa-93cf-6496e11dd30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:56 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Volume 15a409ae-4c87-4dc8-bc3d-69896f3fc0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb', 'volume_size': 1} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e053fbe-6792-4785-8945-ca093414337a,created_at=2026-04-16T09:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880338903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e053fbe-6792-4785-8945-ca093414337a,host='devstack@QuobyteHD#QuobyteHD',id=15a409ae-4c87-4dc8-bc3d-69896f3fc0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:28:56Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29f6a0d8-ca2e-4cd3-8300-7001bbabbaea),volume_type_id=29f6a0d8-ca2e-4cd3-8300-7001bbabbaea)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Creating volume 15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:28:56 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:56 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb 1073741824 Apr 16 11:28:56 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created reservations ['e2d0226c-86f8-46af-8c79-8bd4fcbc20e4', 'edcab68f-8799-43db-a98e-b08f6734ba7a', '2ef23358-5770-44d8-bf5a-f02ed0f329be', '15d256ed-4ce4-40b4-9ded-04b7f14d6846'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:56 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:56 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:56 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639" returned: 0 in 0.599s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:56 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639 Apr 16 11:28:56 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:56 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb 1073741824" returned: 0 in 0.556s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:56 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Deleted volume successfully. Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-208df3ed-2548-4a47-833f-fbdc5750cfa9 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-73c78c75-0227-4ce7-9102-edd556555555-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:56 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb Apr 16 11:28:56 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:56 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.d19ce4a2-2487-474c-ace8-cbb468927639" returned: 0 in 0.454s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-d19ce4a2-2487-474c-ace8-cbb468927639" released by "_delete_snapshot" :: held 2.189s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" released by "delete_snapshot" :: held 2.204s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Created reservations ['39f256cd-1afd-4506-8b48-0eabacece665', '9ad51727-d4e5-4b55-8f3b-5664986b2cc3', '4234fd1b-c2b7-4416-b3a5-a4314d896861', '0b69f0bb-a2dd-4139-bb3e-cffe30035bff'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Delete snapshot completed successfully. Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a89d477b-d2fc-4790-b1fc-006c1bb0c937 tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-d19ce4a2-2487-474c-ace8-cbb468927639-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-5259fd46-0fbb-4e16-b7b7-aae227eb5939-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-5259fd46-0fbb-4e16-b7b7-aae227eb5939-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-quobyte-5259fd46-0fbb-4e16-b7b7-aae227eb5939" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-5259fd46-0fbb-4e16-b7b7-aae227eb5939" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[69975a70-5f08-48f7-ae33-e8385ae991f7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:57 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 Apr 16 11:28:57 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:57 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fcef5f-8e7f-4dfa-93cf-6496e11dd30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f72a5b9-907c-4344-acdd-3d9552d02cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:28:57 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Volume volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb (15a409ae-4c87-4dc8-bc3d-69896f3fc0cb): created successfully Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f72a5b9-907c-4344-acdd-3d9552d02cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (1f1abd07-8b38-43fd-b1a9-303c52aa7280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:28:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6afcbca5-870b-4dcf-a239-4ae9a6286687 tempest-GroupSnapshotsTest-756277891 None] Created volume successfully. Apr 16 11:28:57 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939" returned: 0 in 0.473s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:57 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939 Apr 16 11:28:57 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:58 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5259fd46-0fbb-4e16-b7b7-aae227eb5939" returned: 0 in 0.453s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-5259fd46-0fbb-4e16-b7b7-aae227eb5939" released by "delete_volume" :: held 0.966s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Creating offline snapshot 414bdd62-1675-4c78-865d-c23043859eb5 of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d09fc1-70dc-4ad0-b200-7e929485d027]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created reservations ['1c3c04dc-92a6-4264-b1f3-c7f42a93dbd2', '98061a5c-6293-456e-ba36-4c5f0ceaeb8e', '25b1dfeb-2eb3-434d-9c1b-b8038b4c761d', '6f02ba70-9244-4beb-8fad-dc6de201b0c7'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:58 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:28:58 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:58 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:28:58 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-3319e75c-4642-49de-a349-2ca6f461ebe1 tempest-GroupSnapshotsTest-756277891 None] Update group completed successfully. Apr 16 11:28:58 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.412s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:28:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Deleted volume successfully. Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c0c61fc8-d6ce-4543-b5ff-a0912a0d9e5b tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-5259fd46-0fbb-4e16-b7b7-aae227eb5939-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:28:58 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.528s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:28:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:58 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 1G Apr 16 11:28:58 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:59 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 1G" returned: 0 in 0.515s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:59 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 Apr 16 11:28:59 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-9b2e1610-df93-48b9-891f-528bc7ec7756-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-9b2e1610-df93-48b9-891f-528bc7ec7756-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-quobyte-9b2e1610-df93-48b9-891f-528bc7ec7756" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-9b2e1610-df93-48b9-891f-528bc7ec7756" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde3b66d-742e-4e6b-9859-d3fdd0f05e24]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:59 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 Apr 16 11:28:59 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-3448cd42-37b0-4935-b35e-b4ed7b4fcd26 tempest-GroupSnapshotsTest-756277891 None] Update group completed successfully. Apr 16 11:28:59 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:59 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 is being set with open permissions: ugo+rw Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:59 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 Apr 16 11:28:59 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:28:59 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:28:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:28:59 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756 Apr 16 11:28:59 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:00 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c141fe9b-9a6b-439d-baed-20bb403112bb tempest-SnapshotsActionsTest-204488925 None] Create snapshot completed successfully Apr 16 11:29:00 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9b2e1610-df93-48b9-891f-528bc7ec7756" returned: 0 in 0.462s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-9b2e1610-df93-48b9-891f-528bc7ec7756" released by "delete_volume" :: held 0.954s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created reservations ['c2ae5aad-a408-46a1-a9c5-b2aeabc888b4', '238727f7-382c-413a-b5dc-5f911a0da99d', '0423616f-62d6-4776-8647-b98a78590eef', 'fb118729-eb3a-4cd3-b4ca-f52438484d42'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:00 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:00 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-26c9bb9e-11fb-46d1-96ee-dd79a6133c22-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-26c9bb9e-11fb-46d1-96ee-dd79a6133c22-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-quobyte-26c9bb9e-11fb-46d1-96ee-dd79a6133c22" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-26c9bb9e-11fb-46d1-96ee-dd79a6133c22" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16ec050-b111-4594-aba5-7f65ffed0a13]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-30f14f01-18b5-435b-9caa-35a4425422f5 tempest-GroupSnapshotsTest-756277891 None] Update group completed successfully. Apr 16 11:29:00 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 Apr 16 11:29:00 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:00 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.522s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Deleted volume successfully. Apr 16 11:29:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6213ba0-6110-4520-b9c5-2ee4ef71e817 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-9b2e1610-df93-48b9-891f-528bc7ec7756-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:01 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22" returned: 0 in 0.660s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:01 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22 Apr 16 11:29:01 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-414bdd62-1675-4c78-865d-c23043859eb5-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-414bdd62-1675-4c78-865d-c23043859eb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-414bdd62-1675-4c78-865d-c23043859eb5" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-414bdd62-1675-4c78-865d-c23043859eb5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Deleting offline snapshot 414bdd62-1675-4c78-865d-c23043859eb5 of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] snapshot_file for this snap is: volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[254d7af0-63d8-4bf4-973e-f14248e115a7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:01 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 Apr 16 11:29:01 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:01 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-26c9bb9e-11fb-46d1-96ee-dd79a6133c22" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-26c9bb9e-11fb-46d1-96ee-dd79a6133c22" released by "delete_volume" :: held 1.187s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created reservations ['b20bbb20-12a8-4793-88a7-45c2b79336dd', 'c06b1710-2277-4b82-93a3-c9815b368856', '7d4c0f41-b8bc-46a1-9615-d890a39310fa', 'a3bca240-4139-4cec-ba62-5fb78ae29a90'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:01 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c3e26ccb-4f3a-4171-bf66-345c85250470 tempest-GroupSnapshotsTest-756277891 None] Update group completed successfully. Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:01 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:01 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:01 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5" returned: 0 in 0.537s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd714af-9e2b-47f7-9825-3a81008efd7f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:02 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:29:02 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:02 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.476s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:02 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Deleted volume successfully. Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a825b51-fcee-4ed0-b9d9-29b8c93d7055 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-26c9bb9e-11fb-46d1-96ee-dd79a6133c22-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:02 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.537s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:02 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 Apr 16 11:29:02 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-eacf5233-bccc-4985-a899-d28fbcd2532b-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-eacf5233-bccc-4985-a899-d28fbcd2532b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:DELETE=13,cinder:UPDATE=167,cinder:SELECT=169,cinder:INSERT=45 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "cinder-quobyte-eacf5233-bccc-4985-a899-d28fbcd2532b" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-eacf5233-bccc-4985-a899-d28fbcd2532b" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e313161-0759-4fc9-ac99-1bfcbf6314ec]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:02 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b Apr 16 11:29:02 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:02 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:03 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5 Apr 16 11:29:03 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] GroupSnapshot c7f207b2-964c-440c-a46a-5f1964e6c957: creating. Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Group snapshot c7f207b2-964c-440c-a46a-5f1964e6c957: creating. {{(pid=83804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Creating offline snapshot 30379ec0-1cd5-484f-8259-d2abc7e15a89 of volume 4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e809bc-0b65-4ee7-8d14-30953abf6d41]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:03 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da Apr 16 11:29:03 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:03 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b" returned: 0 in 0.543s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:03 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b Apr 16 11:29:03 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:03 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.414bdd62-1675-4c78-865d-c23043859eb5" returned: 0 in 0.535s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-414bdd62-1675-4c78-865d-c23043859eb5" released by "_delete_snapshot" :: held 2.171s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" released by "delete_snapshot" :: held 2.182s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Created reservations ['1c7f1775-9fcd-4432-86ca-1eedc2265860', 'f11978ec-91e4-48e9-b48e-2a333d670a56', '28312d33-168d-4875-83ff-c478d72d665c', 'e1add4de-690b-4cbb-9233-80a4d00ff847'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Delete snapshot completed successfully. Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-536162d3-1978-4e50-a9a2-060938e3f2db tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-414bdd62-1675-4c78-865d-c23043859eb5-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:03 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da" returned: 0 in 0.576s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:03 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 1G Apr 16 11:29:03 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:03 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-eacf5233-bccc-4985-a899-d28fbcd2532b" returned: 0 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-quobyte-eacf5233-bccc-4985-a899-d28fbcd2532b" released by "delete_volume" :: held 1.055s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Created reservations ['340ef5d1-2937-483d-949e-36ae2abf9f39', '8962c5ff-c68d-4ece-9cdc-53d11393de6b', '06c025c0-656d-4992-a10e-e932ced61c74', '237ef3ff-c360-4226-b1b2-5e38ab9e4184'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:03 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:03 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:04 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 1G" returned: 0 in 0.527s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cda3e49-e843-4688-9a8b-7e039275f0da -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:04 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.416s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:04 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Deleted volume successfully. Apr 16 11:29:04 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cda3e49-e843-4688-9a8b-7e039275f0da -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 Apr 16 11:29:04 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-909e2aec-b7dd-4c47-9eef-5de3f499cbd7 tempest-CreateVolumesFromSourceVolumeTest-1023592549 None] Lock "cinder-eacf5233-bccc-4985-a899-d28fbcd2532b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=211,cinder:DELETE=18,cinder:SELECT=174,cinder:INSERT=43 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:04 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cda3e49-e843-4688-9a8b-7e039275f0da -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:04 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:29:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:04 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 Apr 16 11:29:04 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:05 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:05 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.info Apr 16 11:29:05 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:05 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.info" returned: 0 in 0.500s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:05 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:29:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:05 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.info Apr 16 11:29:05 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:06 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.info" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Creating offline snapshot 44e24cf8-0035-4067-a6ff-331a91d4148e of volume 15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca677e-2fed-4f61-bc83-d13bb2592030]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:06 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb Apr 16 11:29:06 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:06 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" returned: 0 in 0.633s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:06 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e 1G Apr 16 11:29:06 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:07 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e 1G" returned: 0 in 0.537s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:07 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e Apr 16 11:29:07 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:07 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e" returned: 0 in 0.453s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:07 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:29:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:07 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e Apr 16 11:29:07 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:08 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e" returned: 0 in 0.450s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:08 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.info Apr 16 11:29:08 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc89b6ee-e9c3-44f7-b411-05df4061f492 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112" by "attach_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc89b6ee-e9c3-44f7-b411-05df4061f492 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112" acquired by "attach_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc89b6ee-e9c3-44f7-b411-05df4061f492 tempest-VolumesActionsTest-1421715999 None] Attaching volume 426e7cd7-b70f-432b-bba2-cdd058c4d112 to instance c80f93e2-1d9b-40e8-93cc-6494d56c592e at mountpoint /dev/vdb on host None. Apr 16 11:29:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc89b6ee-e9c3-44f7-b411-05df4061f492 tempest-VolumesActionsTest-1421715999 None] Attach volume completed successfully. Apr 16 11:29:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc89b6ee-e9c3-44f7-b411-05df4061f492 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112" released by "attach_volume" :: held 0.058s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:08 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.info" returned: 0 in 0.446s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:08 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:29:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:08 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.info Apr 16 11:29:08 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5cc8b659-cef3-4bfd-8cb6-6ea3be32f3a4 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-detach_volume" by "detach_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5cc8b659-cef3-4bfd-8cb6-6ea3be32f3a4 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:09 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5cc8b659-cef3-4bfd-8cb6-6ea3be32f3a4 tempest-VolumesActionsTest-1421715999 None] Detaching volume 426e7cd7-b70f-432b-bba2-cdd058c4d112 from instance c80f93e2-1d9b-40e8-93cc-6494d56c592e. Apr 16 11:29:09 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5cc8b659-cef3-4bfd-8cb6-6ea3be32f3a4 tempest-VolumesActionsTest-1421715999 None] Detach volume completed successfully. Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5cc8b659-cef3-4bfd-8cb6-6ea3be32f3a4 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:09 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.info" returned: 0 in 0.428s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.015s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.500s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Creating offline snapshot 5e220733-4555-4462-831a-feb40faed930 of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d8b3c7-2f2f-44b4-8725-5e90ddf0761a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:09 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:29:09 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:09 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dcc32a72-d00d-482d-846b-37c70e0e13b4 tempest-GroupSnapshotsTest-756277891 None] group_snapshot c7f207b2-964c-440c-a46a-5f1964e6c957: created successfully Apr 16 11:29:09 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.499s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:09 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 1G Apr 16 11:29:09 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:10 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 1G" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:10 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 Apr 16 11:29:10 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:10 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] group_snapshot c7f207b2-964c-440c-a46a-5f1964e6c957: deleting Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] group_snapshot c7f207b2-964c-440c-a46a-5f1964e6c957: deleting {{(pid=83804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-4cda3e49-e843-4688-9a8b-7e039275f0da" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-4cda3e49-e843-4688-9a8b-7e039275f0da" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-30379ec0-1cd5-484f-8259-d2abc7e15a89" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-30379ec0-1cd5-484f-8259-d2abc7e15a89" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Deleting offline snapshot 30379ec0-1cd5-484f-8259-d2abc7e15a89 of volume 4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] snapshot_file for this snap is: volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[849d4f84-2d27-4538-bec6-7cdddb393118]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:10 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 Apr 16 11:29:10 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:10 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:10 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 is being set with open permissions: ugo+rw Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:10 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 Apr 16 11:29:10 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:10 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:10 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:11 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930" returned: 0 in 0.638s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:11 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89" returned: 0 in 0.836s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cda3e49-e843-4688-9a8b-7e039275f0da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[47537c85-280b-431b-92d7-4225142cba60]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:11 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.599s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:11 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6d466fb7-b2c7-4193-a83b-c1044b67a5ca tempest-SnapshotsActionsTest-204488925 None] Create snapshot completed successfully Apr 16 11:29:11 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da Apr 16 11:29:11 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:11 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:11 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 Apr 16 11:29:11 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-5e220733-4555-4462-831a-feb40faed930-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-5e220733-4555-4462-831a-feb40faed930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Acquiring lock "cinder-quobyte-5e220733-4555-4462-831a-feb40faed930" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5e220733-4555-4462-831a-feb40faed930" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Deleting offline snapshot 5e220733-4555-4462-831a-feb40faed930 of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] snapshot_file for this snap is: volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d04ee30-6221-4a28-86ec-7615b042d062]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:12 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 Apr 16 11:29:12 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:12 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:12 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89 Apr 16 11:29:12 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:12 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930" returned: 0 in 0.515s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c531ab4e-7ed9-421f-9588-6730693b666f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:12 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:29:12 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:12 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da.30379ec0-1cd5-484f-8259-d2abc7e15a89" returned: 0 in 0.443s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-30379ec0-1cd5-484f-8259-d2abc7e15a89" released by "_delete_snapshot" :: held 2.292s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-4cda3e49-e843-4688-9a8b-7e039275f0da" released by "delete_snapshot" :: held 2.303s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-44e24cf8-0035-4067-a6ff-331a91d4148e" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-44e24cf8-0035-4067-a6ff-331a91d4148e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Deleting offline snapshot 44e24cf8-0035-4067-a6ff-331a91d4148e of volume 15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] snapshot_file for this snap is: volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7928ddba-b542-407b-8f28-c2a2dfc4369f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:12 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e Apr 16 11:29:12 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:13 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.470s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:13 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 Apr 16 11:29:13 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:13 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e" returned: 0 in 0.482s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb6a53-9cd4-48eb-b24d-2d9542bfc754]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:13 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb Apr 16 11:29:13 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:13 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930" returned: 0 in 0.506s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:13 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930 Apr 16 11:29:13 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:13 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:13 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e Apr 16 11:29:13 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:14 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.5e220733-4555-4462-831a-feb40faed930" returned: 0 in 0.420s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5e220733-4555-4462-831a-feb40faed930" released by "_delete_snapshot" :: held 1.962s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" released by "delete_snapshot" :: held 1.978s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Created reservations ['49fc69ae-ea06-4f28-94ea-6a9f9983ccff', 'acc2224b-4ae3-4dde-bd15-1d7358b8e05d', '959b99a5-a14b-4918-a2f6-fec28918cb4c', '282c5131-a21f-4d0c-9f14-55911f44497b'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Delete snapshot completed successfully. Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a0f9907d-c0ce-4ac9-898b-4527e64ae18a tempest-SnapshotsActionsTest-1630532297 None] Lock "cinder-5e220733-4555-4462-831a-feb40faed930-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:14 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e" returned: 0 in 0.481s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:14 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e Apr 16 11:29:14 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "cinder-e729e03e-0de0-4762-bdf4-708cb4f2514f-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-e729e03e-0de0-4762-bdf4-708cb4f2514f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "cinder-quobyte-e729e03e-0de0-4762-bdf4-708cb4f2514f" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-quobyte-e729e03e-0de0-4762-bdf4-708cb4f2514f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Deleting offline snapshot e729e03e-0de0-4762-bdf4-708cb4f2514f of volume 5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] snapshot_file for this snap is: volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[63979e75-6c11-4807-8c88-302e7198cf11]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:14 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:29:14 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:14 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb.44e24cf8-0035-4067-a6ff-331a91d4148e" returned: 0 in 0.441s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-44e24cf8-0035-4067-a6ff-331a91d4148e" released by "_delete_snapshot" :: held 1.931s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" released by "delete_snapshot" :: held 1.941s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:14 devstack cinder-volume[83804]: WARNING cinder.quota [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2003129322 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2003129322, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:14 devstack cinder-volume[83804]: WARNING cinder.quota [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2003129322 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2003129322, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['3a24c33d-0ea3-4c04-b6e7-de3a433280db', 'a12d6aab-e6c2-4396-b5f6-5ac142df5f00', 'd38bf915-2f1f-4d71-85df-0286f9df8c84', 'f4cf7151-0aaf-4964-b111-335f88bfef92'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['a779df7f-9f44-4ef6-9baa-19cf9795c393', '9804eeef-7247-4139-ae11-dc15f9e16ed2', '141632fa-408c-467d-8220-6180911ee494', '4ed2280b-4339-4d91-86de-c473baad3895'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4ed8c898-63be-4b9a-92c1-629ad38c8b80 tempest-GroupSnapshotsTest-756277891 None] group_snapshot c7f207b2-964c-440c-a46a-5f1964e6c957: deleted successfully Apr 16 11:29:14 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da4249c-4018-4012-ae0c-7552e2a62073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[477566bb-3ef2-4ea9-8577-bf8dd1f8c49b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:15 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 Apr 16 11:29:15 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:15 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073" returned: 0 in 0.466s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:15 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:29:15 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:16 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.576s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[22de4c12-b7d9-4e2e-afbe-6966f8c52905]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:16 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f Apr 16 11:29:16 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:16 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb Apr 16 11:29:16 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:16 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073.e729e03e-0de0-4762-bdf4-708cb4f2514f" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-quobyte-e729e03e-0de0-4762-bdf4-708cb4f2514f" released by "_delete_snapshot" :: held 2.078s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" released by "delete_snapshot" :: held 2.093s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Created reservations ['63b5d15f-f5f5-43c0-a84b-a1d110add309', '0bf1c233-6989-4069-835b-6909da083b8a', '7b3419b6-f924-4097-b01e-bf51a633f2ad', '90840769-6067-44c8-93e1-70b9c269f46c'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Delete snapshot completed successfully. Apr 16 11:29:16 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" returned: 0 in 0.573s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1227f682-f851-478a-9553-90f1df29b537 tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-e729e03e-0de0-4762-bdf4-708cb4f2514f-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:16 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb Apr 16 11:29:16 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12d929-c385-4978-8e7c-58aab15ddec7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:17 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" returned: 0 in 0.420s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:17 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:17 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-15a409ae-4c87-4dc8-bc3d-69896f3fc0cb" released by "delete_volume" :: held 1.037s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-4cda3e49-e843-4688-9a8b-7e039275f0da" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-4cda3e49-e843-4688-9a8b-7e039275f0da" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[733705b2-404e-4c96-b081-2708a08585e4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:17 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da Apr 16 11:29:17 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:17 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e3c43-3960-4d54-9684-ad84ef85541c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:17 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:17 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:17 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:17 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da Apr 16 11:29:17 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "cinder-5da4249c-4018-4012-ae0c-7552e2a62073-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-5da4249c-4018-4012-ae0c-7552e2a62073-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b339b0c-1b7b-49b3-96e8-a3a7ed216f03]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:17 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 Apr 16 11:29:17 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:17 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.0ad2783a-18a0-4e6d-909a-fe6a7167e02bdk68i26e.img {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:17 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.0ad2783a-18a0-4e6d-909a-fe6a7167e02bdk68i26e.img Apr 16 11:29:17 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:18 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4cda3e49-e843-4688-9a8b-7e039275f0da" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-4cda3e49-e843-4688-9a8b-7e039275f0da" released by "delete_volume" :: held 0.965s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['aaf00b52-8707-45d2-9588-f1b66ae48ad6'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:18 devstack cinder-volume[83804]: WARNING cinder.quota [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2003129322 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2003129322, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['c1053e50-9e45-4054-ada9-6c5f5b767a0b', '4e315132-060d-44a6-aa3f-e3eeb776a7c2', 'fba23fff-0211-4246-a9f9-c150e0c52b54', '78f2ad9f-3027-46e7-98ed-ace60aa8cf81'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['14de77fd-21a6-4751-8a65-1dcd35794eda', 'bf2fffe3-3ad8-4e78-bbdc-ae473a9ecf24', 'e572d977-12fe-4c59-84bf-d400ed7a2d86', '763c0de7-755d-488b-a411-5659c8b00b21'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:18 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073" returned: 0 in 0.496s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:18 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073 Apr 16 11:29:18 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:18 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:18 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:19 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5da4249c-4018-4012-ae0c-7552e2a62073" returned: 0 in 0.817s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-quobyte-5da4249c-4018-4012-ae0c-7552e2a62073" released by "delete_volume" :: held 1.348s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Created reservations ['c9de1361-ab8d-45b8-9b1f-1558df80d0a8', '28f0b1ee-0128-41cc-8c6c-b95fd946f68b', '4dcbcb96-8f93-467d-83f3-914893161fbb', '25d8d1a1-7d75-42e9-b035-cbbafca5e319'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:19 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:19 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:19 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.476s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:19 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:19 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f652cfa7-0a32-4049-a0c0-a8353cf16950 tempest-GroupSnapshotsTest-756277891 None] Delete group completed successfully. Apr 16 11:29:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc7e5077-0258-4f54-8368-09fbf265d23d tempest-GroupSnapshotsTest-756277891 None] Group tempest-GroupSnapshotsTest-Group-1789901807: creating Apr 16 11:29:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc7e5077-0258-4f54-8368-09fbf265d23d tempest-GroupSnapshotsTest-756277891 None] Group tempest-GroupSnapshotsTest-Group-1789901807: created successfully Apr 16 11:29:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc7e5077-0258-4f54-8368-09fbf265d23d tempest-GroupSnapshotsTest-756277891 None] Create group completed successfully. Apr 16 11:29:20 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.0ad2783a-18a0-4e6d-909a-fe6a7167e02bdk68i26e.img" returned: 0 in 2.175s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[08737993-7080-492e-aec8-caf25204bca8]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:20 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:20 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:20 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.867s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Deleted volume successfully. Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57f70c27-3b20-436e-98f4-107daa16dd6d tempest-SnapshotsActionsTest-204488925 None] Lock "cinder-5da4249c-4018-4012-ae0c-7552e2a62073-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:20 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.634s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.0ad2783a-18a0-4e6d-909a-fe6a7167e02bdk68i26e.img {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:29:20 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Converted 1024.00 MB image at 470.45 MB/s Apr 16 11:29:20 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] 0ad2783a-18a0-4e6d-909a-fe6a7167e02b was raw, no need to convert to raw {{(pid=83804) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (a10c1dcd-0565-4ba0-8d40-82d4d10dcfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71ee815-71ed-41e2-933a-9b1a127fa624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71ee815-71ed-41e2-933a-9b1a127fa624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1672036478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3b01b50-1aed-47c4-b0f7-4f24b889d986,host='devstack@QuobyteHD#QuobyteHD',id=f0d524f3-ea13-4d08-a144-c83319eb1cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:21Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b1e49e0-b9ef-4204-8207-a615665ed98f),volume_type_id=1b1e49e0-b9ef-4204-8207-a615665ed98f)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be129e17-19ab-49cc-b565-9881c491df8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be129e17-19ab-49cc-b565-9881c491df8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed981b1f-d6c1-4a66-8306-abe90969485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed981b1f-d6c1-4a66-8306-abe90969485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d524f3-ea13-4d08-a144-c83319eb1cd2', 'volume_name': 'volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632d363b-4e08-42d9-9788-a08b7a0ed6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632d363b-4e08-42d9-9788-a08b7a0ed6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c5d3f2-c0fd-4c39-852a-697a6e96f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:21 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Volume f0d524f3-ea13-4d08-a144-c83319eb1cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2', 'volume_size': 1} Apr 16 11:29:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Flow 'volume_create_manager' (335f01cb-535a-45ba-861e-7761630eb212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea05048-3cbc-4bca-a3fe-35395330276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea05048-3cbc-4bca-a3fe-35395330276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-478583267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f21e84-cd3d-466b-bb48-5fd750cf4988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633c769ead54a5da0e8554d65f05d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:23Z,use_quota=True,user_id='82dd20614da549419c6577b22f9223f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b60e75-d8a0-45e7-a64b-dd201ba61731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b60e75-d8a0-45e7-a64b-dd201ba61731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced9480-65b5-4627-8d37-8aa36da3b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced9480-65b5-4627-8d37-8aa36da3b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f21e84-cd3d-466b-bb48-5fd750cf4988', 'volume_name': 'volume-91f21e84-cd3d-466b-bb48-5fd750cf4988', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffe5447-1126-4b09-87b4-d7694c81c0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffe5447-1126-4b09-87b4-d7694c81c0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1297920-7256-407b-b917-a4d490f943e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:23 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Volume 91f21e84-cd3d-466b-bb48-5fd750cf4988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f21e84-cd3d-466b-bb48-5fd750cf4988', 'volume_size': 1} Apr 16 11:29:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.679s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Uploaded volume to glance image-id: 0ad2783a-18a0-4e6d-909a-fe6a7167e02b. {{(pid=83804) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.130s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3b01b50-1aed-47c4-b0f7-4f24b889d986,created_at=2026-04-16T09:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1672036478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3b01b50-1aed-47c4-b0f7-4f24b889d986,host='devstack@QuobyteHD#QuobyteHD',id=f0d524f3-ea13-4d08-a144-c83319eb1cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5cd6f1c585470483409e4479f19d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:21Z,use_quota=True,user_id='be4013f012354f7cb49686ae0e255113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b1e49e0-b9ef-4204-8207-a615665ed98f),volume_type_id=1b1e49e0-b9ef-4204-8207-a615665ed98f)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Creating volume f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:30 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:30 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 1073741824 Apr 16 11:29:30 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f1a31b07-22fc-422b-9751-5fabc482bbbe tempest-VolumesActionsTest-1421715999 None] Copy volume to image completed successfully. Apr 16 11:29:31 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 1073741824" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:31 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 Apr 16 11:29:31 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:31 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2" returned: 0 in 0.413s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.216s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-478583267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f21e84-cd3d-466b-bb48-5fd750cf4988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633c769ead54a5da0e8554d65f05d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:23Z,use_quota=True,user_id='82dd20614da549419c6577b22f9223f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Creating volume 91f21e84-cd3d-466b-bb48-5fd750cf4988 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:31 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:31 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 1073741824 Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c5d3f2-c0fd-4c39-852a-697a6e96f33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:31 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f2fbb3-5d0d-44e6-973a-2afe1149d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:31 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Volume volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 (f0d524f3-ea13-4d08-a144-c83319eb1cd2): created successfully Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f2fbb3-5d0d-44e6-973a-2afe1149d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Flow 'volume_create_manager' (a10c1dcd-0565-4ba0-8d40-82d4d10dcfdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:31 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-46143de1-1641-46c0-8cdd-b23d8c17d489 tempest-GroupSnapshotsTest-756277891 None] Created volume successfully. Apr 16 11:29:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:32 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 1073741824" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:32 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 Apr 16 11:29:32 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] GroupSnapshot 22bc8d2d-97aa-4ab6-9ce3-051d40b5066a: creating. Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Group snapshot 22bc8d2d-97aa-4ab6-9ce3-051d40b5066a: creating. {{(pid=83804) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:32 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.622s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1297920-7256-407b-b917-a4d490f943e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f21e84-cd3d-466b-bb48-5fd750cf4988', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627b6b9b-8e4a-4aa3-8adb-fd8f8b288724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9c46b0-ade7-41e4-aee9-cda65a25e3d0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:32 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Volume volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 (91f21e84-cd3d-466b-bb48-5fd750cf4988): created successfully Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627b6b9b-8e4a-4aa3-8adb-fd8f8b288724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Flow 'volume_create_manager' (335f01cb-535a-45ba-861e-7761630eb212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d1289a72-584a-42b5-8e45-e248d9c8b190 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Created volume successfully. Apr 16 11:29:32 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:32 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:33 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55ee1d7-b5b8-47e1-a87f-7c20839ddf4b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:33 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:33 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Acquiring lock "cinder-91f21e84-cd3d-466b-bb48-5fd750cf4988-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "cinder-91f21e84-cd3d-466b-bb48-5fd750cf4988-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Acquiring lock "cinder-quobyte-91f21e84-cd3d-466b-bb48-5fd750cf4988" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "cinder-quobyte-91f21e84-cd3d-466b-bb48-5fd750cf4988" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3891b938-9d75-4283-a9c6-259fb68aadec]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:33 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 Apr 16 11:29:33 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:33 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:33 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img Apr 16 11:29:33 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:33 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:33 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988 Apr 16 11:29:33 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:34 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-91f21e84-cd3d-466b-bb48-5fd750cf4988" returned: 0 in 0.874s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "cinder-quobyte-91f21e84-cd3d-466b-bb48-5fd750cf4988" released by "delete_volume" :: held 1.364s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Created reservations ['577c7c93-95e1-428b-ba1a-d8718f3f0693', '32e60952-2ab4-40f8-862d-82bf3097d5d6', 'a4ba8572-e0d2-460b-97a3-8836b2960f22', 'a2166c70-7ce8-4b40-b81d-81bfd95e4f83'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:35 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:35 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:35 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img" returned: 0 in 2.083s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab827584-4d74-4928-9573-982d70aca84e]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:35 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:35 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:35 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.818s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:35 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Deleted volume successfully. Apr 16 11:29:36 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.614s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:29:36 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Converted 1024.00 MB image at 491.30 MB/s Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0c4eec07-9c62-455b-b790-feeeb35b4065 tempest-VolumeQuotasNegativeTestJSON-745366469 None] Lock "cinder-91f21e84-cd3d-466b-bb48-5fd750cf4988-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] 1e033a92-819f-4eaf-93f4-0b37a5da51fe was raw, converting to qcow2 {{(pid=83804) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a903c-9761-4454-9b90-2a64a51cd6c0]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:36 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img Apr 16 11:29:36 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:36 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img" returned: 0 in 0.476s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:36 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img Apr 16 11:29:36 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:37 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img" returned: 1 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:29:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img /opt/stack/data/cinder/conversion/vol_upload_pgto4mbw {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:37 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img /opt/stack/data/cinder/conversion/vol_upload_pgto4mbw Apr 16 11:29:37 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:37 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img /opt/stack/data/cinder/conversion/vol_upload_pgto4mbw" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:37 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Image conversion details: src /opt/stack/data/cinder/conversion/426e7cd7-b70f-432b-bba2-cdd058c4d112.temp_image.1e033a92-819f-4eaf-93f4-0b37a5da51fe13tkq9d7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pgto4mbw {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:29:37 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 16 11:29:37 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb13f8d-16b4-4064-9148-0861d7c770dd]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pgto4mbw {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:37 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pgto4mbw Apr 16 11:29:37 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:38 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pgto4mbw" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.614s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Uploaded volume to glance image-id: 1e033a92-819f-4eaf-93f4-0b37a5da51fe. {{(pid=83804) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.783s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:39 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d32c7294-b601-4328-b4d8-1df7db9bfba9 tempest-VolumesActionsTest-1421715999 None] Copy volume to image completed successfully. Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Creating offline snapshot 777bf694-c0fe-4dcd-9cae-6c523aabad4e of volume f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c7ba99-135d-4aba-943b-b0b45fefa8ff]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:39 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 Apr 16 11:29:39 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Flow 'volume_create_manager' (816eb68f-8155-4023-8f89-7341cf967199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401fd2e7-7c31-4463-a6be-cc382a66e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401fd2e7-7c31-4463-a6be-cc382a66e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-280926903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f423e54b-3e45-4066-af09-943e2641cd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa71557514e4b9287e88538497d8b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:39Z,use_quota=True,user_id='016c2cd0d5e1458395279372052d4d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d5685e5-e702-4fb3-a7a2-0ad2c4aa9dac),volume_type_id=4d5685e5-e702-4fb3-a7a2-0ad2c4aa9dac)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585d517e-0532-4797-a030-e8b10d5fd742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585d517e-0532-4797-a030-e8b10d5fd742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd25013e-66e7-4ab0-945e-c95727a1f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd25013e-66e7-4ab0-945e-c95727a1f61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f423e54b-3e45-4066-af09-943e2641cd0b', 'volume_name': 'volume-f423e54b-3e45-4066-af09-943e2641cd0b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310992eb-129f-408a-a45d-b431f8e85ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310992eb-129f-408a-a45d-b431f8e85ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b8efde-b6f6-4adf-87eb-379541313c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:39 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Volume f423e54b-3e45-4066-af09-943e2641cd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f423e54b-3e45-4066-af09-943e2641cd0b', 'volume_size': 1} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:39 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2" returned: 0 in 0.493s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:39 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e 1G Apr 16 11:29:39 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:40 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e 1G" returned: 0 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:40 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e Apr 16 11:29:40 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "cinder-quobyte-426e7cd7-b70f-432b-bba2-cdd058c4d112" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-quobyte-426e7cd7-b70f-432b-bba2-cdd058c4d112" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[40244f4b-f911-44bb-9ffd-a006fedc3ce0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:40 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:40 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:29:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:40 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:40 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:40 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e Apr 16 11:29:40 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:41 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e" returned: 0 in 0.407s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:41 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.488s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:41 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112 Apr 16 11:29:41 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:41 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.info Apr 16 11:29:41 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:41 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-426e7cd7-b70f-432b-bba2-cdd058c4d112" returned: 0 in 0.419s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-quobyte-426e7cd7-b70f-432b-bba2-cdd058c4d112" released by "delete_volume" :: held 0.925s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:41 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.info" returned: 0 in 0.431s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:41 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Created reservations ['6db068fc-92a6-4b11-aab1-f8573ba2ffbe', '8751bbd8-8200-4665-a07b-b66638ec5fc2', 'd15b7e81-8d57-47d8-bcb9-88b9ef87fcf8', '04489b14-a91d-4823-a62c-6f2565f72992'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:41 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.info Apr 16 11:29:41 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:41 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:41 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:41 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.info" returned: 0 in 0.431s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.606s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-280926903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f423e54b-3e45-4066-af09-943e2641cd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa71557514e4b9287e88538497d8b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:39Z,use_quota=True,user_id='016c2cd0d5e1458395279372052d4d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d5685e5-e702-4fb3-a7a2-0ad2c4aa9dac),volume_type_id=4d5685e5-e702-4fb3-a7a2-0ad2c4aa9dac)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Creating volume f423e54b-3e45-4066-af09-943e2641cd0b {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:41 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:42 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b 1073741824 Apr 16 11:29:42 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:42 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.446s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:42 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Deleted volume successfully. Apr 16 11:29:42 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2312c51d-4a15-47ca-b00c-4c40cdb7a12d tempest-GroupSnapshotsTest-756277891 None] group_snapshot 22bc8d2d-97aa-4ab6-9ce3-051d40b5066a: created successfully Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c911de6-a3af-4edf-ae0a-870cac968f19 tempest-VolumesActionsTest-1421715999 None] Lock "cinder-426e7cd7-b70f-432b-bba2-cdd058c4d112-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:42 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b 1073741824" returned: 0 in 0.525s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:42 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b Apr 16 11:29:42 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:42 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] group_snapshot 22bc8d2d-97aa-4ab6-9ce3-051d40b5066a: deleting Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] group_snapshot 22bc8d2d-97aa-4ab6-9ce3-051d40b5066a: deleting {{(pid=83804) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-f0d524f3-ea13-4d08-a144-c83319eb1cd2" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-f0d524f3-ea13-4d08-a144-c83319eb1cd2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-777bf694-c0fe-4dcd-9cae-6c523aabad4e" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-777bf694-c0fe-4dcd-9cae-6c523aabad4e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Deleting offline snapshot 777bf694-c0fe-4dcd-9cae-6c523aabad4e of volume f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] snapshot_file for this snap is: volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fd9c8b-6c1a-48ea-aad3-1a994b9b27b5]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:43 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b8efde-b6f6-4adf-87eb-379541313c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f423e54b-3e45-4066-af09-943e2641cd0b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b565da0-afb2-477e-9329-25b566b57173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:43 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Volume volume-f423e54b-3e45-4066-af09-943e2641cd0b (f423e54b-3e45-4066-af09-943e2641cd0b): created successfully Apr 16 11:29:43 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e Apr 16 11:29:43 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b565da0-afb2-477e-9329-25b566b57173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Flow 'volume_create_manager' (816eb68f-8155-4023-8f89-7341cf967199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-76884c36-1874-4b67-b99c-7a8b6764f656 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Created volume successfully. Apr 16 11:29:43 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dbc6ac-2bde-4315-8e5c-85122b2992d4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:43 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 Apr 16 11:29:43 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:43 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:43 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:44 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2" returned: 0 in 0.524s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:44 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e Apr 16 11:29:44 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:44 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.479s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:44 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-13a04679-a010-4079-9f4b-c7de1a377bff tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Retype volume completed successfully. Apr 16 11:29:44 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e" returned: 0 in 0.498s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:44 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e Apr 16 11:29:44 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:45 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Acquiring lock "cinder-f423e54b-3e45-4066-af09-943e2641cd0b-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2.777bf694-c0fe-4dcd-9cae-6c523aabad4e" returned: 0 in 0.515s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-777bf694-c0fe-4dcd-9cae-6c523aabad4e" released by "_delete_snapshot" :: held 2.154s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "cinder-f423e54b-3e45-4066-af09-943e2641cd0b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-f0d524f3-ea13-4d08-a144-c83319eb1cd2" released by "delete_snapshot" :: held 2.171s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Acquiring lock "cinder-quobyte-f423e54b-3e45-4066-af09-943e2641cd0b" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "cinder-quobyte-f423e54b-3e45-4066-af09-943e2641cd0b" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc5ce73-07df-484f-9c8a-227e66424056]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:45 devstack cinder-volume[83804]: WARNING cinder.quota [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-280968713 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-280968713, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:45 devstack cinder-volume[83804]: WARNING cinder.quota [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-280968713 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-280968713, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['52bcd35f-57e0-4163-afd4-cf23596f556d', '521ea1d3-df8c-4db1-baf6-635766695b6f', '5b595c7d-e558-44d1-8fdb-d6c5102c89a9', '36c0a6cd-e3c6-4a5d-8e14-190c23aae167'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:45 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b Apr 16 11:29:45 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:45 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7dcd8a75-4aca-424b-9ffd-e685a0089732 tempest-GroupSnapshotsTest-756277891 None] group_snapshot 22bc8d2d-97aa-4ab6-9ce3-051d40b5066a: deleted successfully Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Flow 'volume_create_manager' (0fa60c22-a770-42a2-a6fa-0f3214777ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e5fd77-b908-4088-875f-2c2c4f1b12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e5fd77-b908-4088-875f-2c2c4f1b12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2091983103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff661a3-9873-4e22-81f3-b95a063a60cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f069b0a4186241fe905753bbb0f8054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:46Z,use_quota=True,user_id='c000af6a11ef49bbb79cbe4fc7a9bee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e86973-c647-49e7-9aed-2a2340efeb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e86973-c647-49e7-9aed-2a2340efeb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c60fd8a-16ef-42ec-ba3a-5f77a4e2cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c60fd8a-16ef-42ec-ba3a-5f77a4e2cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff661a3-9873-4e22-81f3-b95a063a60cd', 'volume_name': 'volume-9ff661a3-9873-4e22-81f3-b95a063a60cd', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818d9cea-29a8-4533-a09f-bda16580ad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818d9cea-29a8-4533-a09f-bda16580ad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338bc32d-0249-41c2-b5c2-99fc0f2a57ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Volume 9ff661a3-9873-4e22-81f3-b95a063a60cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff661a3-9873-4e22-81f3-b95a063a60cd', 'volume_size': 1} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2091983103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff661a3-9873-4e22-81f3-b95a063a60cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f069b0a4186241fe905753bbb0f8054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:46Z,use_quota=True,user_id='c000af6a11ef49bbb79cbe4fc7a9bee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Creating volume 9ff661a3-9873-4e22-81f3-b95a063a60cd {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:45 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:45 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:45 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd 1073741824 Apr 16 11:29:45 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:45 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b Apr 16 11:29:45 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:46 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:46 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd 1073741824" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f423e54b-3e45-4066-af09-943e2641cd0b" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "cinder-quobyte-f423e54b-3e45-4066-af09-943e2641cd0b" released by "delete_volume" :: held 0.977s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:46 devstack cinder-volume[83804]: WARNING cinder.quota [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:46 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd Apr 16 11:29:46 devstack cinder-volume[83804]: WARNING cinder.quota [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:46 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Created reservations ['b2dac71d-5882-4e5d-bb30-258c323d0491', 'f129e9d9-a30b-4922-a6de-c9baf1ecaab4', '0d0d4bfe-4a21-4500-89c9-27b42b1741fd', '4d063ec0-1eb6-4635-9e22-582a02df30b1'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:46 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:46 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "cinder-quobyte-f0d524f3-ea13-4d08-a144-c83319eb1cd2" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-f0d524f3-ea13-4d08-a144-c83319eb1cd2" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[007248b0-5df8-437a-8711-59e49f249377]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:46 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 Apr 16 11:29:46 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:46 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd" returned: 0 in 0.441s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338bc32d-0249-41c2-b5c2-99fc0f2a57ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff661a3-9873-4e22-81f3-b95a063a60cd', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ce1b41-52f4-4c09-8791-3815ebf57929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:46 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Volume volume-9ff661a3-9873-4e22-81f3-b95a063a60cd (9ff661a3-9873-4e22-81f3-b95a063a60cd): created successfully Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ce1b41-52f4-4c09-8791-3815ebf57929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Flow 'volume_create_manager' (0fa60c22-a770-42a2-a6fa-0f3214777ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-823ec761-1006-49a8-8f6c-60a0ef3e2087 tempest-VolumesListTestJSON-722785629 None] Created volume successfully. Apr 16 11:29:46 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.429s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Deleted volume successfully. Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-479066f4-1749-41b2-81bb-4f0691353447 tempest-VolumeRetypeWithoutMigrationTest-795386362 None] Lock "cinder-f423e54b-3e45-4066-af09-943e2641cd0b-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:46 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:46 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2 Apr 16 11:29:46 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:47 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f0d524f3-ea13-4d08-a144-c83319eb1cd2" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Lock "cinder-quobyte-f0d524f3-ea13-4d08-a144-c83319eb1cd2" released by "delete_volume" :: held 0.944s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['3d445272-f1fb-4a8f-bd72-f94e5a2fcd09'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:47 devstack cinder-volume[83804]: WARNING cinder.quota [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-280968713 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-280968713, it is now deprecated. Please use the default quota class for default quota. Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Created reservations ['eab1f0ac-c248-454f-ac81-65e7c9e564fb', 'deaf6ead-bedd-41f7-af06-7c2b87f19dfa', 'b1e1ed3b-03c2-4831-9ec2-f1b4a108aa7a', 'ffc0c35c-99b9-4d5c-b0d2-fb8c680c9c45'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:47 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:47 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:47 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.472s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:47 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f3a7e69d-e2ba-4b53-8f85-3d0f77625801 tempest-GroupSnapshotsTest-756277891 None] Delete group completed successfully. Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Flow 'volume_create_manager' (eae176b7-f8fe-4686-ad0e-3ed2a5d4b589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90666aa-1f98-45cc-9921-30da2ec25f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90666aa-1f98-45cc-9921-30da2ec25f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-727586906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb5f621-09f3-43bc-a876-dffb1c7817b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f069b0a4186241fe905753bbb0f8054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:48Z,use_quota=True,user_id='c000af6a11ef49bbb79cbe4fc7a9bee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6947f257-723e-4ca2-bc6f-7b1aa5dcd899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6947f257-723e-4ca2-bc6f-7b1aa5dcd899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289540ce-aa57-4678-8355-50e96482208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289540ce-aa57-4678-8355-50e96482208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb5f621-09f3-43bc-a876-dffb1c7817b8', 'volume_name': 'volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9195960c-45b6-48cf-aaec-a4da03042569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9195960c-45b6-48cf-aaec-a4da03042569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12dccc-238c-44d3-8f79-9e46c4384106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:48 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Volume aeb5f621-09f3-43bc-a876-dffb1c7817b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8', 'volume_size': 1} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-727586906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb5f621-09f3-43bc-a876-dffb1c7817b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f069b0a4186241fe905753bbb0f8054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:48Z,use_quota=True,user_id='c000af6a11ef49bbb79cbe4fc7a9bee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Creating volume aeb5f621-09f3-43bc-a876-dffb1c7817b8 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:48 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:48 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 1073741824 Apr 16 11:29:48 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:48 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 1073741824" returned: 0 in 0.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:48 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 Apr 16 11:29:48 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:49 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12dccc-238c-44d3-8f79-9e46c4384106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1342bc4c-9619-47ba-baa3-6c842ca5fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:49 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Volume volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 (aeb5f621-09f3-43bc-a876-dffb1c7817b8): created successfully Apr 16 11:29:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1342bc4c-9619-47ba-baa3-6c842ca5fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Flow 'volume_create_manager' (eae176b7-f8fe-4686-ad0e-3ed2a5d4b589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:49 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-63ff04d4-7e7b-4477-81c4-3a120e62d326 tempest-VolumesListTestJSON-722785629 None] Created volume successfully. Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Flow 'volume_create_manager' (f37c0eca-4bca-426c-bfc3-7f9eb7ef6528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7379dda8-2940-4bb2-ad7c-6b6bb30d349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7379dda8-2940-4bb2-ad7c-6b6bb30d349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2057388445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bc5fc5-0687-4cb8-b079-20b09c443993,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f069b0a4186241fe905753bbb0f8054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:50Z,use_quota=True,user_id='c000af6a11ef49bbb79cbe4fc7a9bee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa315083-266d-41f7-9d71-71a37bedd629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa315083-266d-41f7-9d71-71a37bedd629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f353a6-c068-481d-8755-4264567a5a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f353a6-c068-481d-8755-4264567a5a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9bc5fc5-0687-4cb8-b079-20b09c443993', 'volume_name': 'volume-d9bc5fc5-0687-4cb8-b079-20b09c443993', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3657e9a-055d-4dd4-bf08-a2f7cae9900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3657e9a-055d-4dd4-bf08-a2f7cae9900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef624b4-e012-4a7a-936d-544dcc10c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Volume d9bc5fc5-0687-4cb8-b079-20b09c443993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9bc5fc5-0687-4cb8-b079-20b09c443993', 'volume_size': 1} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2057388445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bc5fc5-0687-4cb8-b079-20b09c443993,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f069b0a4186241fe905753bbb0f8054a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:50Z,use_quota=True,user_id='c000af6a11ef49bbb79cbe4fc7a9bee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Creating volume d9bc5fc5-0687-4cb8-b079-20b09c443993 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:50 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:50 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 1073741824 Apr 16 11:29:50 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Flow 'volume_create_manager' (90530fe7-6453-44c2-81a3-114e9653d348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4844950-82d3-444a-b107-1a8af6d3663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4844950-82d3-444a-b107-1a8af6d3663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-734332360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7986d5d2-f045-410c-b634-8967ed58ca7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c4b6939502471baf89d3b1fac5a074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:51Z,use_quota=True,user_id='c026556cd00f4e548067bf0250202a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50751704-448c-4e4d-af93-5133e64db9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50751704-448c-4e4d-af93-5133e64db9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5e6552-bd87-437c-a0ab-b461a458e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5e6552-bd87-437c-a0ab-b461a458e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7986d5d2-f045-410c-b634-8967ed58ca7a', 'volume_name': 'volume-7986d5d2-f045-410c-b634-8967ed58ca7a', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2477817-c2eb-4e14-8b33-611bc7be8cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2477817-c2eb-4e14-8b33-611bc7be8cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40f1b90-ea73-4430-942e-0d7264ae75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Volume 7986d5d2-f045-410c-b634-8967ed58ca7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7986d5d2-f045-410c-b634-8967ed58ca7a', 'volume_size': 1} Apr 16 11:29:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:51 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 1073741824" returned: 0 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:51 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 Apr 16 11:29:51 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:51 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993" returned: 0 in 0.480s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-734332360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7986d5d2-f045-410c-b634-8967ed58ca7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c4b6939502471baf89d3b1fac5a074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:51Z,use_quota=True,user_id='c026556cd00f4e548067bf0250202a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Creating volume 7986d5d2-f045-410c-b634-8967ed58ca7a {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:51 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef624b4-e012-4a7a-936d-544dcc10c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9bc5fc5-0687-4cb8-b079-20b09c443993', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:51 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a 1073741824 Apr 16 11:29:51 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d43366-12cf-474b-bb2d-36c27d485a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Volume volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 (d9bc5fc5-0687-4cb8-b079-20b09c443993): created successfully Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d43366-12cf-474b-bb2d-36c27d485a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Flow 'volume_create_manager' (f37c0eca-4bca-426c-bfc3-7f9eb7ef6528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:51 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-51082867-4eaa-4585-92b7-6f1b285e84e1 tempest-VolumesListTestJSON-722785629 None] Created volume successfully. Apr 16 11:29:52 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a 1073741824" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:52 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a Apr 16 11:29:52 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:52 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40f1b90-ea73-4430-942e-0d7264ae75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7986d5d2-f045-410c-b634-8967ed58ca7a', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41e8376-017a-4c70-879c-616a7f2d1734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Volume volume-7986d5d2-f045-410c-b634-8967ed58ca7a (7986d5d2-f045-410c-b634-8967ed58ca7a): created successfully Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41e8376-017a-4c70-879c-616a7f2d1734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Flow 'volume_create_manager' (90530fe7-6453-44c2-81a3-114e9653d348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-58a1fbf6-bc68-46f7-b052-27d093093ab3 tempest-VolumesServicesTestJSON-2056046840 None] Created volume successfully. Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Acquiring lock "cinder-7986d5d2-f045-410c-b634-8967ed58ca7a-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Lock "cinder-7986d5d2-f045-410c-b634-8967ed58ca7a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Acquiring lock "cinder-quobyte-7986d5d2-f045-410c-b634-8967ed58ca7a" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Lock "cinder-quobyte-7986d5d2-f045-410c-b634-8967ed58ca7a" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:53 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[88300e41-9280-4fc1-89bc-11620ab14160]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:53 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a Apr 16 11:29:53 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:53 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a" returned: 0 in 0.574s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:53 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a Apr 16 11:29:53 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:54 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7986d5d2-f045-410c-b634-8967ed58ca7a" returned: 0 in 0.451s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Lock "cinder-quobyte-7986d5d2-f045-410c-b634-8967ed58ca7a" released by "delete_volume" :: held 1.057s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Created reservations ['5d4c2802-71c2-4312-92b7-6757ee5b5697', 'c1ce29e8-da4e-450e-9ea7-fd79e4ecf4bd', 'a559184c-aa69-47d6-84e4-d549df95a59a', '8b244573-4510-43c7-8db9-c516d19255d6'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:54 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:54 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "cinder-d9bc5fc5-0687-4cb8-b079-20b09c443993-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-d9bc5fc5-0687-4cb8-b079-20b09c443993-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "cinder-quobyte-d9bc5fc5-0687-4cb8-b079-20b09c443993" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-quobyte-d9bc5fc5-0687-4cb8-b079-20b09c443993" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c0ccf1-2ad7-4a7c-8586-5a8470c79067]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:54 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 Apr 16 11:29:54 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:54 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.535s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Deleted volume successfully. Apr 16 11:29:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eacf1df4-3191-4f49-a761-2c6748ac7195 tempest-VolumesServicesTestJSON-2056046840 None] Lock "cinder-7986d5d2-f045-410c-b634-8967ed58ca7a-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:55 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993" returned: 0 in 0.606s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:55 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993 Apr 16 11:29:55 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:55 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d9bc5fc5-0687-4cb8-b079-20b09c443993" returned: 0 in 0.456s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-quobyte-d9bc5fc5-0687-4cb8-b079-20b09c443993" released by "delete_volume" :: held 1.083s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Created reservations ['3f5646ff-2fb1-4334-8773-425bb55220e3', '1f98dba4-5d2c-46fb-8287-fa4190d22371', '5115a358-c541-435b-92d1-63ceef289543', '2a569680-4cbb-4908-a2eb-2447d23f2afe'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:55 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:55 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:56 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Deleted volume successfully. Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6688314b-bae6-448b-b3b5-60f86e7cb1e4 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-d9bc5fc5-0687-4cb8-b079-20b09c443993-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Acquiring lock "cinder-aeb5f621-09f3-43bc-a876-dffb1c7817b8-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Lock "cinder-aeb5f621-09f3-43bc-a876-dffb1c7817b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Acquiring lock "cinder-quobyte-aeb5f621-09f3-43bc-a876-dffb1c7817b8" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Lock "cinder-quobyte-aeb5f621-09f3-43bc-a876-dffb1c7817b8" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab0bd5-1277-46ea-b132-0ad5f3538b4a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:56 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 Apr 16 11:29:56 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:57 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8" returned: 0 in 0.567s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:57 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8 Apr 16 11:29:57 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:57 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-aeb5f621-09f3-43bc-a876-dffb1c7817b8" returned: 0 in 0.599s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Lock "cinder-quobyte-aeb5f621-09f3-43bc-a876-dffb1c7817b8" released by "delete_volume" :: held 1.188s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Created reservations ['46b9bd6c-7d83-4c31-aeff-be910f64c09a', 'e7173978-ce0a-4cee-be99-019f3bcee873', '686a6307-283b-454b-97e1-b172686fb451', '737d33f2-e967-4efb-b81b-32331d7b9e02'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:58 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:29:58 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Flow 'volume_create_manager' (70189e47-b9c5-4c4c-8443-b3b834ceb46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead05cef-5070-44fa-9238-064da5e429cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead05cef-5070-44fa-9238-064da5e429cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-442309435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f05aa399ef44d608e135b0f6e24a6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:58Z,use_quota=True,user_id='497bd8937e6345c7978e449801f3b7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27718e6-3a0b-483f-a41e-1546ba65eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27718e6-3a0b-483f-a41e-1546ba65eb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb76cb4-98db-491f-859a-084ef1279e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb76cb4-98db-491f-859a-084ef1279e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c', 'volume_name': 'volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e87f0f5-d4db-4a3a-a8a8-379d39eb535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e87f0f5-d4db-4a3a-a8a8-379d39eb535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14962650-946d-4314-acfb-3251cb98a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:58 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Volume 4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c', 'volume_size': 1} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-442309435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f05aa399ef44d608e135b0f6e24a6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:29:58Z,use_quota=True,user_id='497bd8937e6345c7978e449801f3b7c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Creating volume 4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:29:58 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:29:58 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.461s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:29:58 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c 1073741824 Apr 16 11:29:58 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Deleted volume successfully. Apr 16 11:29:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1dc765b9-3d8a-4398-8717-4455e190f9ab tempest-VolumesListTestJSON-722785629 None] Lock "cinder-aeb5f621-09f3-43bc-a876-dffb1c7817b8-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "cinder-9ff661a3-9873-4e22-81f3-b95a063a60cd-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-9ff661a3-9873-4e22-81f3-b95a063a60cd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "cinder-quobyte-9ff661a3-9873-4e22-81f3-b95a063a60cd" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-quobyte-9ff661a3-9873-4e22-81f3-b95a063a60cd" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab44e350-7a7c-4f41-8946-b127834d777b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:59 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c 1073741824" returned: 0 in 0.623s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:59 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd Apr 16 11:29:59 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:59 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c Apr 16 11:29:59 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:59 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:29:59 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd Apr 16 11:29:59 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:29:59 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14962650-946d-4314-acfb-3251cb98a848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5869919d-f0d7-4261-9403-a734950448fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:29:59 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Volume volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c (4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c): created successfully Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5869919d-f0d7-4261-9403-a734950448fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:29:59 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Flow 'volume_create_manager' (70189e47-b9c5-4c4c-8443-b3b834ceb46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:29:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8e170bce-70b2-4ccd-9ccf-4f1bc842ce7a tempest-AbsoluteLimitsTests-40232957 None] Created volume successfully. Apr 16 11:30:00 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ff661a3-9873-4e22-81f3-b95a063a60cd" returned: 0 in 0.488s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-quobyte-9ff661a3-9873-4e22-81f3-b95a063a60cd" released by "delete_volume" :: held 1.025s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Created reservations ['6e2a0a8d-4045-4a9d-8eb4-86706e9010fb', 'a385be3e-7477-4d82-880b-de9ac21a2e09', 'ff51de44-5c8c-4426-b64e-62cf5d8ba074', '45f5d54d-701d-4a67-9224-19e9eb4a9ef1'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:00 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:00 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Acquiring lock "cinder-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Lock "cinder-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:00 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.507s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Acquiring lock "cinder-quobyte-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Deleted volume successfully. Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Lock "cinder-quobyte-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c" acquired by "delete_volume" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9c176e51-e8e9-4ec4-9c51-77b309f07dc7 tempest-VolumesListTestJSON-722785629 None] Lock "cinder-9ff661a3-9873-4e22-81f3-b95a063a60cd-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ad6bf-b431-43cf-a589-da099007bcfb]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:00 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c Apr 16 11:30:00 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:01 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c" returned: 0 in 0.601s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:01 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c Apr 16 11:30:01 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:01 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c" returned: 0 in 0.567s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Lock "cinder-quobyte-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c" released by "delete_volume" :: held 1.201s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:01 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Created reservations ['b948f3a0-d961-41a7-bce1-8282c946881e', 'a427f222-03cc-487e-8f2e-a1d41c92ec73', '071bb675-530c-4787-9ccc-5da054db9234', 'a2076d87-4a31-4bd4-8825-ddbe06de91c1'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:02 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:02 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:02 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:02 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Deleted volume successfully. Apr 16 11:30:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4df27f8a-6f64-4beb-ae72-7be361803355 tempest-AbsoluteLimitsTests-40232957 None] Lock "cinder-4e0b9341-ae6e-4aac-89d4-a3ef7523ac5c-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=168,cinder:INSERT=46,cinder:UPDATE=182,cinder:DELETE=4 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=175,cinder:SELECT=135,cinder:INSERT=40,cinder:DELETE=14 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Flow 'volume_create_manager' (419c4d35-fa8b-476f-888b-627989ee6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb297d82-d151-4b48-91ca-ca0e401005ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb297d82-d151-4b48-91ca-ca0e401005ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1435425664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766b3257-3e97-4449-8912-75f404b78917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c298e02e47af4c2388a47bf1fb0551ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:07Z,use_quota=True,user_id='57e62c0cb0414b3d847a1581963e104b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea735e8-b7a2-4692-b882-04e5130c7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea735e8-b7a2-4692-b882-04e5130c7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf9148a-c61c-4c20-8921-f3dac8a5bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf9148a-c61c-4c20-8921-f3dac8a5bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766b3257-3e97-4449-8912-75f404b78917', 'volume_name': 'volume-766b3257-3e97-4449-8912-75f404b78917', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4480a81-9162-4481-858d-8a016493fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4480a81-9162-4481-858d-8a016493fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b4c70-d924-4f71-8147-d8e3a8afe8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:07 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Volume 766b3257-3e97-4449-8912-75f404b78917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766b3257-3e97-4449-8912-75f404b78917', 'volume_size': 1} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1435425664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766b3257-3e97-4449-8912-75f404b78917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c298e02e47af4c2388a47bf1fb0551ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:07Z,use_quota=True,user_id='57e62c0cb0414b3d847a1581963e104b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Creating volume 766b3257-3e97-4449-8912-75f404b78917 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:07 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:07 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 1073741824 Apr 16 11:30:07 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:07 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 1073741824" returned: 0 in 0.585s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:07 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 Apr 16 11:30:07 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:08 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917" returned: 0 in 0.517s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942b4c70-d924-4f71-8147-d8e3a8afe8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766b3257-3e97-4449-8912-75f404b78917', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4805ed-ff38-42e1-bcc3-f1bda98488d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Volume volume-766b3257-3e97-4449-8912-75f404b78917 (766b3257-3e97-4449-8912-75f404b78917): created successfully Apr 16 11:30:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4805ed-ff38-42e1-bcc3-f1bda98488d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Flow 'volume_create_manager' (419c4d35-fa8b-476f-888b-627989ee6b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ef77e3c3-9314-4bde-90a5-b2044104f886 tempest-VolumesMetadataTest-1517366109 None] Created volume successfully. Apr 16 11:30:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Acquiring lock "cinder-766b3257-3e97-4449-8912-75f404b78917-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Lock "cinder-766b3257-3e97-4449-8912-75f404b78917-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Acquiring lock "cinder-quobyte-766b3257-3e97-4449-8912-75f404b78917" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Lock "cinder-quobyte-766b3257-3e97-4449-8912-75f404b78917" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd57cec-971b-4b98-be5d-134ec7cd8984]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:09 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 Apr 16 11:30:09 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:10 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917" returned: 0 in 0.497s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:10 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917 Apr 16 11:30:10 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:10 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:10 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:10 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-766b3257-3e97-4449-8912-75f404b78917" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Lock "cinder-quobyte-766b3257-3e97-4449-8912-75f404b78917" released by "delete_volume" :: held 1.055s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Created reservations ['682e8158-382e-4e03-a293-8b63c846b48e', '99672d48-00d6-4378-b10e-d281f2544bdf', '8df73663-8ef1-492a-8307-2fe492530210', '29545de8-8638-4aae-85cb-e9e6bd6ed198'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:11 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:11 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:11 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.615s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:11 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.626s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:11 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Deleted volume successfully. Apr 16 11:30:11 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dfe6c87f-d719-4459-84f5-f57e627100eb tempest-VolumesMetadataTest-1517366109 None] Lock "cinder-766b3257-3e97-4449-8912-75f404b78917-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (41956e1b-06dc-4dd7-911a-593ef3c28ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e67689b-b154-4f87-bfdb-fd5d7df9ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e67689b-b154-4f87-bfdb-fd5d7df9ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-521675084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caec68c-556c-4521-b217-96a0411285c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:13Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827eecdf-2235-41c6-851d-86ad25d9b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827eecdf-2235-41c6-851d-86ad25d9b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd2ec9d-582b-47f2-90b7-2e934a31f727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd2ec9d-582b-47f2-90b7-2e934a31f727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5caec68c-556c-4521-b217-96a0411285c5', 'volume_name': 'volume-5caec68c-556c-4521-b217-96a0411285c5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a6a339-b698-427e-a025-a98ea96b1dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a6a339-b698-427e-a025-a98ea96b1dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784b82a6-13b2-4523-8191-df5bfa1bc669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:13 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume 5caec68c-556c-4521-b217-96a0411285c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5caec68c-556c-4521-b217-96a0411285c5', 'volume_size': 1} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-521675084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caec68c-556c-4521-b217-96a0411285c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:13Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Creating volume 5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:13 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:13 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 1073741824 Apr 16 11:30:13 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:14 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 1073741824" returned: 0 in 0.629s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:14 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 Apr 16 11:30:14 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:14 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5" returned: 0 in 0.544s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784b82a6-13b2-4523-8191-df5bfa1bc669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5caec68c-556c-4521-b217-96a0411285c5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a8b2af-b5b0-4b07-9139-5c54a1b79e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:14 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume volume-5caec68c-556c-4521-b217-96a0411285c5 (5caec68c-556c-4521-b217-96a0411285c5): created successfully Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a8b2af-b5b0-4b07-9139-5c54a1b79e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (41956e1b-06dc-4dd7-911a-593ef3c28ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-3c2294c6-6a60-4bc2-b034-892388977da2 tempest-VolumesSnapshotTestJSON-1549192242 None] Created volume successfully. Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Flow 'volume_create_manager' (676ce158-d009-4767-966d-c5feccf664bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7dd899-e6c1-465d-85e9-bf06b0197f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7dd899-e6c1-465d-85e9-bf06b0197f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-259552665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d775d9-6386-456a-9caa-812bad4930cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68084b9c1894456c89ba4f6e68afd152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:15Z,use_quota=True,user_id='4d9fb7d165434bf9b443459e3c04203c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f3a727-9825-4b71-b58c-e9126d17d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f3a727-9825-4b71-b58c-e9126d17d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd459d1b-88be-43d3-bb2f-5e790bd0778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.image.glance [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Creating Keystone auth plugin from conf {{(pid=83804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd459d1b-88be-43d3-bb2f-5e790bd0778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96d775d9-6386-456a-9caa-812bad4930cb', 'volume_name': 'volume-96d775d9-6386-456a-9caa-812bad4930cb', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac726d4d-55c4-4ec8-a7b9-8bffaa1245fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac726d4d-55c4-4ec8-a7b9-8bffaa1245fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fcfc25-f957-4eef-9e37-f82433c58143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:15 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Volume 96d775d9-6386-456a-9caa-812bad4930cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96d775d9-6386-456a-9caa-812bad4930cb', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Trying to clone 96d775d9-6386-456a-9caa-812bad4930cb from image 7a555815-8ed6-4460-8cae-4d0c09c11911 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]). {{(pid=83804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Creating offline snapshot 051ec80c-923b-48e2-9d88-e7c169c39807 of volume 5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c33374-29a6-435d-87c4-a18ef8ee74b2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:15 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 Apr 16 11:30:15 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 11:30:15 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Image download 20.69 MB at 20.69 MB/s Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a3d643-b360-4240-899f-342112e3e12d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:16 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD Apr 16 11:30:16 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:16 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5" returned: 0 in 0.670s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:16 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 1G Apr 16 11:30:16 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:16 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD" returned: 0 in 0.566s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 is fetched for user 4d9fb7d165434bf9b443459e3c04203c. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f352bf1a-ead6-48e3-b273-1d1da2f73600]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:16 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD Apr 16 11:30:16 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:16 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 1G" returned: 0 in 0.497s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caec68c-556c-4521-b217-96a0411285c5 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:16 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caec68c-556c-4521-b217-96a0411285c5 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 Apr 16 11:30:16 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:17 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:17 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caec68c-556c-4521-b217-96a0411285c5 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807" returned: 0 in 0.428s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:17 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 is being set with open permissions: ugo+rw Apr 16 11:30:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:17 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 Apr 16 11:30:17 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:17 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807" returned: 0 in 0.435s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:17 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.info Apr 16 11:30:17 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:18 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.info" returned: 0 in 0.417s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:18 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.info is being set with open permissions: ugo+rw Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:18 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.info Apr 16 11:30:18 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:18 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.info" returned: 0 in 0.406s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.912s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-259552665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d775d9-6386-456a-9caa-812bad4930cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68084b9c1894456c89ba4f6e68afd152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:15Z,use_quota=True,user_id='4d9fb7d165434bf9b443459e3c04203c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Creating volume 96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:18 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:18 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 1073741824 Apr 16 11:30:18 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-de7b4de0-9924-456f-9e91-02126433762f tempest-VolumesSnapshotTestJSON-1549192242 None] Create snapshot completed successfully Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-051ec80c-923b-48e2-9d88-e7c169c39807-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-051ec80c-923b-48e2-9d88-e7c169c39807-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-5caec68c-556c-4521-b217-96a0411285c5" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-5caec68c-556c-4521-b217-96a0411285c5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-051ec80c-923b-48e2-9d88-e7c169c39807" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-051ec80c-923b-48e2-9d88-e7c169c39807" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Deleting offline snapshot 051ec80c-923b-48e2-9d88-e7c169c39807 of volume 5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] snapshot_file for this snap is: volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e12ec-573c-4d7a-adaa-4db685359843]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:19 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 Apr 16 11:30:19 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:19 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 1073741824" returned: 0 in 0.521s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:19 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:19 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:19 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5caec68c-556c-4521-b217-96a0411285c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4d3e60-31f6-4a41-a48f-9557c944b2f0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:19 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 Apr 16 11:30:19 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:19 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 0 in 0.442s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Attempting download of 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume 96d775d9-6386-456a-9caa-812bad4930cb. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[25102123-f5a8-4188-9b85-18d22b75c3fc]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_c3xhj6wf {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:19 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_c3xhj6wf Apr 16 11:30:19 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:19 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5" returned: 0 in 0.543s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:19 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 Apr 16 11:30:20 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:20 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_c3xhj6wf" returned: 0 in 0.517s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_c3xhj6wf {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:20 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_c3xhj6wf Apr 16 11:30:20 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:20 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807" returned: 0 in 0.496s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:20 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807 Apr 16 11:30:20 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:20 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_c3xhj6wf" returned: 1 in 0.537s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_c3xhj6wf' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4825deca-269a-4259-a227-5d54537a6dc5]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:20 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD Apr 16 11:30:20 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:20 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5.051ec80c-923b-48e2-9d88-e7c169c39807" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-051ec80c-923b-48e2-9d88-e7c169c39807" released by "_delete_snapshot" :: held 2.065s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-5caec68c-556c-4521-b217-96a0411285c5" released by "delete_snapshot" :: held 2.074s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:21 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['9dcc13c5-e621-4e87-8638-148c42af2095', '93e9228e-0dbb-4aed-b271-6decd24fcc37', 'cda9629c-0c81-46d9-8c2a-020d09667a32', '52e33be6-2166-483a-822c-2dd84d009eea'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:21 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Delete snapshot completed successfully. Apr 16 11:30:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c2de8c9e-0750-463e-8f1b-f155495b6682 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-051ec80c-923b-48e2-9d88-e7c169c39807-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:21 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD" returned: 0 in 0.558s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:21 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] 7a555815-8ed6-4460-8cae-4d0c09c11911 was qcow2, converting to raw {{(pid=83804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 11:30:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:21 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:21 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:22 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 0 in 0.945s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_8w53u_i1devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:30:22 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:22 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 1G Apr 16 11:30:22 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (7df51929-3015-4752-828b-220760aa20fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab89b98c-4884-4802-91c7-f301211f8b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab89b98c-4884-4802-91c7-f301211f8b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1188039558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25796b95-51e3-4704-a2b6-bfbf420c465c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:22Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134cc787-21dc-4d52-a80b-ca9419d499d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134cc787-21dc-4d52-a80b-ca9419d499d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d79689a-44e8-4bb6-bcb7-0fa7dbead920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d79689a-44e8-4bb6-bcb7-0fa7dbead920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25796b95-51e3-4704-a2b6-bfbf420c465c', 'volume_name': 'volume-25796b95-51e3-4704-a2b6-bfbf420c465c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae89d07-1163-4ab9-affa-2a33356801be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae89d07-1163-4ab9-affa-2a33356801be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bcaaf1-4fb4-4679-ac2c-db98102bb6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:22 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume 25796b95-51e3-4704-a2b6-bfbf420c465c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25796b95-51e3-4704-a2b6-bfbf420c465c', 'volume_size': 1} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1188039558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25796b95-51e3-4704-a2b6-bfbf420c465c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:22Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Creating volume 25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:22 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:22 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c 1073741824 Apr 16 11:30:22 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:22 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 1G" returned: 0 in 0.560s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51b120b-b7c5-412c-b18b-c2d48e2f4d4d]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:22 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:22 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:22 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c 1073741824" returned: 0 in 0.510s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:23 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c Apr 16 11:30:23 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:23 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 0 in 0.575s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:23 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:23 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:23 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c" returned: 0 in 0.520s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bcaaf1-4fb4-4679-ac2c-db98102bb6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25796b95-51e3-4704-a2b6-bfbf420c465c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf40737b-a804-4337-a34c-3674107aa7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:23 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume volume-25796b95-51e3-4704-a2b6-bfbf420c465c (25796b95-51e3-4704-a2b6-bfbf420c465c): created successfully Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf40737b-a804-4337-a34c-3674107aa7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (7df51929-3015-4752-828b-220760aa20fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5f55c038-8fd9-42fb-ad6d-90c489fac874 tempest-VolumesSnapshotTestJSON-1549192242 None] Created volume successfully. Apr 16 11:30:23 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 1 in 0.496s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Downloaded image 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume 96d775d9-6386-456a-9caa-812bad4930cb successfully. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 for user 4d9fb7d165434bf9b443459e3c04203c is deleted. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Marking volume 96d775d9-6386-456a-9caa-812bad4930cb as bootable. {{(pid=83804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Copying metadata from image 7a555815-8ed6-4460-8cae-4d0c09c11911 to 96d775d9-6386-456a-9caa-812bad4930cb. {{(pid=83804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Creating volume glance metadata for volume 96d775d9-6386-456a-9caa-812bad4930cb backed by image 7a555815-8ed6-4460-8cae-4d0c09c11911 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fcfc25-f957-4eef-9e37-f82433c58143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d775d9-6386-456a-9caa-812bad4930cb', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5621fb9-9341-47b4-af9b-473f53c5e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:23 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Volume volume-96d775d9-6386-456a-9caa-812bad4930cb (96d775d9-6386-456a-9caa-812bad4930cb): created successfully Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5621fb9-9341-47b4-af9b-473f53c5e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Flow 'volume_create_manager' (676ce158-d009-4767-966d-c5feccf664bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-decf95ce-d0e3-4cc3-8181-da0a11603bb4 tempest-VolumesExtendTest-1863419448 None] Created volume successfully. Apr 16 11:30:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Creating offline snapshot 6b7878e9-2b10-48b8-a791-28e320379004 of volume 25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:30:24 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb9980-4d1a-4482-8d59-93ea4e07dce1]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:24 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c Apr 16 11:30:24 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:25 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c" returned: 0 in 0.516s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:25 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 1G Apr 16 11:30:25 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:25 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 1G" returned: 0 in 0.491s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25796b95-51e3-4704-a2b6-bfbf420c465c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:25 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25796b95-51e3-4704-a2b6-bfbf420c465c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 Apr 16 11:30:25 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:26 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25796b95-51e3-4704-a2b6-bfbf420c465c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004" returned: 0 in 0.543s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:26 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 is being set with open permissions: ugo+rw Apr 16 11:30:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:26 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 Apr 16 11:30:26 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:26 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004" returned: 0 in 0.410s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:26 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.info Apr 16 11:30:26 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:27 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.info" returned: 0 in 0.446s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:27 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.info is being set with open permissions: ugo+rw Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:27 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.info Apr 16 11:30:27 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:27 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.info" returned: 0 in 0.401s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.867s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.649s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:27 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-985572d9-3cd1-404d-adab-5cbd36675fd2 tempest-VolumesSnapshotTestJSON-1549192242 None] Create snapshot completed successfully Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34d3fb-c997-49a3-ba81-a6d92910c508]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:27 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:27 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (450d6cae-a968-4515-84b8-b35548891989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78e612c-4133-4ae3-89ad-3fe8d1d2e573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78e612c-4133-4ae3-89ad-3fe8d1d2e573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1844035675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c864040-95ab-4e0d-a2cc-948988c931fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6b7878e9-2b10-48b8-a791-28e320379004,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:28Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901f41eb-5ca3-4aed-8007-1eaa136b5d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901f41eb-5ca3-4aed-8007-1eaa136b5d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:28 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df40ed8-8f73-4d17-adce-00a8f7d134dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df40ed8-8f73-4d17-adce-00a8f7d134dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c864040-95ab-4e0d-a2cc-948988c931fe', 'volume_name': 'volume-7c864040-95ab-4e0d-a2cc-948988c931fe', 'volume_size': 2, 'snapshot_id': '6b7878e9-2b10-48b8-a791-28e320379004'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dacedca-b421-4d30-9cf1-875cf56c232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dacedca-b421-4d30-9cf1-875cf56c232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174055b3-6683-4db1-9534-9dabf1d74005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:28 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Volume 7c864040-95ab-4e0d-a2cc-948988c931fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c864040-95ab-4e0d-a2cc-948988c931fe', 'volume_size': 2, 'snapshot_id': '6b7878e9-2b10-48b8-a791-28e320379004'} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 0 in 0.545s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:28 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:28 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:28 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 1 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 2G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb 2G" returned: 0 in 0.046s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.095s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.517s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-6b7878e9-2b10-48b8-a791-28e320379004-7c864040-95ab-4e0d-a2cc-948988c931fe" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-6b7878e9-2b10-48b8-a791-28e320379004-7c864040-95ab-4e0d-a2cc-948988c931fe" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Creating volume 7c864040-95ab-4e0d-a2cc-948988c931fe from snapshot 6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-7c864040-95ab-4e0d-a2cc-948988c931fe" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-7c864040-95ab-4e0d-a2cc-948988c931fe" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] snapshot: 6b7878e9-2b10-48b8-a791-28e320379004, volume: 7c864040-95ab-4e0d-a2cc-948988c931fe, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:28 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-39ec1ec3-7099-4569-b067-9f651b9be011 tempest-VolumesExtendTest-1863419448 None] Extend volume completed successfully. Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f2f7c-26f2-4095-b32e-6638ef61d10b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:28 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 Apr 16 11:30:28 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:29 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004" returned: 0 in 0.508s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25796b95-51e3-4704-a2b6-bfbf420c465c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7f3fe-fcc0-4bc4-82b0-8c91dcb53f93]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Acquiring lock "cinder-96d775d9-6386-456a-9caa-812bad4930cb-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Lock "cinder-96d775d9-6386-456a-9caa-812bad4930cb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Acquiring lock "cinder-quobyte-96d775d9-6386-456a-9caa-812bad4930cb" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:29 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c Apr 16 11:30:29 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-96d775d9-6386-456a-9caa-812bad4930cb" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbed18-30dc-4de1-979f-027c5fc68024]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:29 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:29 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:29 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:29 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe Apr 16 11:30:29 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:29 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 0 in 0.491s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:29 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:29 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:30 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 1 in 1.009s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:30:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:30 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb Apr 16 11:30:30 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:31 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-96d775d9-6386-456a-9caa-812bad4930cb" returned: 0 in 1.100s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-96d775d9-6386-456a-9caa-812bad4930cb" released by "delete_volume" :: held 2.663s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Created reservations ['48b3301b-8ab1-441c-97a6-6be78694680a', '1d4a6d22-e132-46b6-98a6-78fe17f11b35', 'bf22f73a-3f96-4e71-8528-dfe5ddbbd9db', '6f9ebfe4-fb8f-48cf-b456-e5eba9bf30f7'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:32 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:32 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:32 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe" returned: 0 in 2.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e965a2-2efa-4c6c-b16f-3b5c3e8a2f3e]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:32 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c Apr 16 11:30:32 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:32 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.603s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Deleted volume successfully. Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f082bc8d-de9d-4d66-abd7-2abc56574a1d tempest-VolumesExtendTest-1863419448 None] Lock "cinder-96d775d9-6386-456a-9caa-812bad4930cb-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:32 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c" returned: 0 in 0.653s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:30:32 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Converted 1024.00 MB image at 411.73 MB/s Apr 16 11:30:32 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe is being set with open permissions: ugo+rw Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:32 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe Apr 16 11:30:32 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Flow 'volume_create_manager' (5a25974d-f488-4ce2-ab81-8ba8a2a84342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfda597e-12f8-4c22-992b-0e3b01eea98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfda597e-12f8-4c22-992b-0e3b01eea98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-441243035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34f7749-fad2-4fd9-bd1e-0d23388a821c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68084b9c1894456c89ba4f6e68afd152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:33Z,use_quota=True,user_id='4d9fb7d165434bf9b443459e3c04203c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30453174-ab79-4015-99aa-d677705b3ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30453174-ab79-4015-99aa-d677705b3ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa291b-3f5c-41eb-9c27-fc3b253b33ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa291b-3f5c-41eb-9c27-fc3b253b33ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34f7749-fad2-4fd9-bd1e-0d23388a821c', 'volume_name': 'volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f516c7df-64b5-4e03-a6b3-884dc1905f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f516c7df-64b5-4e03-a6b3-884dc1905f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f35372-b97e-4778-95cb-fa6cc454908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:32 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Volume a34f7749-fad2-4fd9-bd1e-0d23388a821c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c', 'volume_size': 1} Apr 16 11:30:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:33 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe" returned: 0 in 0.408s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-7c864040-95ab-4e0d-a2cc-948988c931fe" released by "_copy_volume_from_snapshot" :: held 4.622s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-6b7878e9-2b10-48b8-a791-28e320379004-7c864040-95ab-4e0d-a2cc-948988c931fe" released by "_create_volume_from_snapshot" :: held 4.659s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.672s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.261s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-441243035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34f7749-fad2-4fd9-bd1e-0d23388a821c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68084b9c1894456c89ba4f6e68afd152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:33Z,use_quota=True,user_id='4d9fb7d165434bf9b443459e3c04203c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Creating volume a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:33 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:33 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c 1073741824 Apr 16 11:30:33 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174055b3-6683-4db1-9534-9dabf1d74005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c864040-95ab-4e0d-a2cc-948988c931fe', 'volume_size': 2, 'snapshot_id': '6b7878e9-2b10-48b8-a791-28e320379004'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e3eae4-f098-4f8d-a2ce-63765daca7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:33 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Volume volume-7c864040-95ab-4e0d-a2cc-948988c931fe (7c864040-95ab-4e0d-a2cc-948988c931fe): created successfully Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e3eae4-f098-4f8d-a2ce-63765daca7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (450d6cae-a968-4515-84b8-b35548891989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:33 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d94d8b3d-5b2e-462e-8cb4-7081e62a616f tempest-VolumesSnapshotTestJSON-1549192242 None] Created volume successfully. Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (f5891c29-b791-4c43-85dd-8a8ee6755503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fff6b62-f5ce-43cb-b0e1-8cc8f9a1f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fff6b62-f5ce-43cb-b0e1-8cc8f9a1f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-559452869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9636e0-437e-473d-89f7-f83e74ed9474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:34Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cb5a00-30f1-4608-9a9b-967aaf204f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cb5a00-30f1-4608-9a9b-967aaf204f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d602c3-9518-46ff-b831-74251cb9e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d602c3-9518-46ff-b831-74251cb9e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9636e0-437e-473d-89f7-f83e74ed9474', 'volume_name': 'volume-4c9636e0-437e-473d-89f7-f83e74ed9474', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dca3e7f-08a1-43f3-940d-c6b00bc921cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dca3e7f-08a1-43f3-940d-c6b00bc921cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ade5e-9528-4c70-b087-1acc7a2cc9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:33 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Volume 4c9636e0-437e-473d-89f7-f83e74ed9474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9636e0-437e-473d-89f7-f83e74ed9474', 'volume_size': 1} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:33 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c 1073741824" returned: 0 in 0.615s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:33 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c Apr 16 11:30:33 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:34 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c" returned: 0 in 0.434s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-559452869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9636e0-437e-473d-89f7-f83e74ed9474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:34Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Creating volume 4c9636e0-437e-473d-89f7-f83e74ed9474 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:34 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f35372-b97e-4778-95cb-fa6cc454908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:34 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 1073741824 Apr 16 11:30:34 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e3df30-e9c6-4486-9709-ed495f37bf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:34 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Volume volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c (a34f7749-fad2-4fd9-bd1e-0d23388a821c): created successfully Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e3df30-e9c6-4486-9709-ed495f37bf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Flow 'volume_create_manager' (5a25974d-f488-4ce2-ab81-8ba8a2a84342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:34 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d61bbc57-9ecd-4964-9243-f639e1df4ac8 tempest-VolumesExtendTest-1863419448 None] Created volume successfully. Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-7c864040-95ab-4e0d-a2cc-948988c931fe-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-7c864040-95ab-4e0d-a2cc-948988c931fe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-7c864040-95ab-4e0d-a2cc-948988c931fe" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-7c864040-95ab-4e0d-a2cc-948988c931fe" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353605f-910f-4a68-aa58-bf01ea4da423]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:34 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe Apr 16 11:30:34 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:34 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 1073741824" returned: 0 in 0.524s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:34 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 Apr 16 11:30:34 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:35 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe" returned: 0 in 0.535s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:35 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe Apr 16 11:30:35 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:35 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474" returned: 0 in 0.411s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.146s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ade5e-9528-4c70-b087-1acc7a2cc9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9636e0-437e-473d-89f7-f83e74ed9474', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e399d7f0-e940-4895-9fb4-a2dbd415af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Creating offline snapshot f1c7efa6-a9c1-40e2-83ba-873ff9085a70 of volume a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:30:35 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Volume volume-4c9636e0-437e-473d-89f7-f83e74ed9474 (4c9636e0-437e-473d-89f7-f83e74ed9474): created successfully Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e399d7f0-e940-4895-9fb4-a2dbd415af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (f5891c29-b791-4c43-85dd-8a8ee6755503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8286c662-517b-48dc-9566-47abd25f1e07]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-21dd9d1b-2b08-42c7-aee7-25344453689c tempest-VolumesActionsTest-938360159 None] Created volume successfully. Apr 16 11:30:35 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c Apr 16 11:30:35 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:35 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c864040-95ab-4e0d-a2cc-948988c931fe" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-7c864040-95ab-4e0d-a2cc-948988c931fe" released by "delete_volume" :: held 1.071s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['27c468f0-a760-4f0a-ad4d-f5c8c9fe597c', 'b0ad32cb-8cea-4e2d-ae6c-d8c60eb9cfc2', '44a92518-af51-4fb7-a2f6-88930dd49ece', '27d501be-f209-4ade-9a76-90c33840cefc'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:35 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:35 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:35 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-94a9b6e3-0aa7-4119-86ae-b63b85688eaf tempest-VolumesActionsTest-938360159 None] Acquiring lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474" by "attach_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-94a9b6e3-0aa7-4119-86ae-b63b85688eaf tempest-VolumesActionsTest-938360159 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474" acquired by "attach_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:35 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 1G Apr 16 11:30:35 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-94a9b6e3-0aa7-4119-86ae-b63b85688eaf tempest-VolumesActionsTest-938360159 None] Attaching volume 4c9636e0-437e-473d-89f7-f83e74ed9474 to instance cca778c5-9523-4445-964d-faaa554302a5 at mountpoint /dev/vdb on host None. Apr 16 11:30:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-94a9b6e3-0aa7-4119-86ae-b63b85688eaf tempest-VolumesActionsTest-938360159 None] Attach volume completed successfully. Apr 16 11:30:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-94a9b6e3-0aa7-4119-86ae-b63b85688eaf tempest-VolumesActionsTest-938360159 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474" released by "attach_volume" :: held 0.071s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:36 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.473s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:36 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Deleted volume successfully. Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-851caebc-c316-4a7d-887f-5b4af3c61a2c tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-7c864040-95ab-4e0d-a2cc-948988c931fe-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:36 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 1G" returned: 0 in 0.568s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:36 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 Apr 16 11:30:36 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-6b7878e9-2b10-48b8-a791-28e320379004-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-6b7878e9-2b10-48b8-a791-28e320379004-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-25796b95-51e3-4704-a2b6-bfbf420c465c" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-25796b95-51e3-4704-a2b6-bfbf420c465c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-6b7878e9-2b10-48b8-a791-28e320379004" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-6b7878e9-2b10-48b8-a791-28e320379004" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Deleting offline snapshot 6b7878e9-2b10-48b8-a791-28e320379004 of volume 25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] snapshot_file for this snap is: volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b9df3f-a699-4172-94e6-c783a379c9d0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:36 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 Apr 16 11:30:36 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:36 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-07cfac6d-33bf-478b-8fae-c60ffe1a180d tempest-VolumesActionsTest-1426598202 None] Terminate volume connection completed successfully. Apr 16 11:30:36 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70" returned: 0 in 0.476s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:36 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 is being set with open permissions: ugo+rw Apr 16 11:30:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:36 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 Apr 16 11:30:36 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:37 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25796b95-51e3-4704-a2b6-bfbf420c465c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe26eff-54e4-4664-b255-9995dd3bffa3]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:37 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c Apr 16 11:30:37 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-07cfac6d-33bf-478b-8fae-c60ffe1a180d tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-detach_volume" by "detach_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-07cfac6d-33bf-478b-8fae-c60ffe1a180d tempest-VolumesActionsTest-1426598202 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:37 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70" returned: 0 in 0.443s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:37 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-07cfac6d-33bf-478b-8fae-c60ffe1a180d tempest-VolumesActionsTest-1426598202 None] Detaching volume 4c9636e0-437e-473d-89f7-f83e74ed9474 from instance cca778c5-9523-4445-964d-faaa554302a5. Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:37 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.info Apr 16 11:30:37 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-07cfac6d-33bf-478b-8fae-c60ffe1a180d tempest-VolumesActionsTest-1426598202 None] Detach volume completed successfully. Apr 16 11:30:37 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-07cfac6d-33bf-478b-8fae-c60ffe1a180d tempest-VolumesActionsTest-1426598202 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:37 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c" returned: 0 in 0.476s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:37 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 Apr 16 11:30:37 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:37 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.info" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:37 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.info is being set with open permissions: ugo+rw Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:37 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.info Apr 16 11:30:37 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5ac05fec-b422-49aa-bc24-1bd5db8b1808 tempest-VolumesActionsTest-938360159 None] Acquiring lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-detach_volume" by "detach_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5ac05fec-b422-49aa-bc24-1bd5db8b1808 tempest-VolumesActionsTest-938360159 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:37 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5ac05fec-b422-49aa-bc24-1bd5db8b1808 tempest-VolumesActionsTest-938360159 None] Volume detach called, but volume not attached. Apr 16 11:30:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5ac05fec-b422-49aa-bc24-1bd5db8b1808 tempest-VolumesActionsTest-938360159 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:38 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:38 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004 Apr 16 11:30:38 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:38 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.info" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:38 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d647539f-8a71-400d-9f3a-6b6efceaa5ad tempest-VolumesExtendTest-1863419448 None] Create snapshot completed successfully Apr 16 11:30:38 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c.6b7878e9-2b10-48b8-a791-28e320379004" returned: 0 in 0.450s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Acquiring lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-6b7878e9-2b10-48b8-a791-28e320379004" released by "_delete_snapshot" :: held 1.967s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-25796b95-51e3-4704-a2b6-bfbf420c465c" released by "delete_snapshot" :: held 1.991s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Acquiring lock "cinder-quobyte-4c9636e0-437e-473d-89f7-f83e74ed9474" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Lock "cinder-quobyte-4c9636e0-437e-473d-89f7-f83e74ed9474" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['0ce530c2-3c7c-4b84-b1db-88bd0473a317', '417b2aa5-6460-4f7e-8655-839b590bc7ed', 'c59675e2-4b67-46ad-a5ba-df7ad967f967', '91166087-5b58-4557-814e-d1e1ad049f0d'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd244b1-5d00-4851-8caa-66fc395f3902]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:38 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Delete snapshot completed successfully. Apr 16 11:30:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-90b6026c-aaa1-432c-bdc5-0c467f778023 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-6b7878e9-2b10-48b8-a791-28e320379004-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:38 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 Apr 16 11:30:38 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:39 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474" returned: 0 in 0.480s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:39 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474 Apr 16 11:30:39 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a367be04-ca9d-4517-9ab5-9c3a3cf76391]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:39 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c Apr 16 11:30:39 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:39 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c9636e0-437e-473d-89f7-f83e74ed9474" returned: 0 in 0.470s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Lock "cinder-quobyte-4c9636e0-437e-473d-89f7-f83e74ed9474" released by "delete_volume" :: held 0.971s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Created reservations ['bada693d-63ca-4373-9447-cee36040d453', '5fadedf3-aa71-43db-b070-ab9221a8fd3a', 'c0b7ad01-4127-4a54-8e6c-493a61a3bdad', 'c990e1a5-07c5-4581-b297-d1342577d645'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:39 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:39 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-25796b95-51e3-4704-a2b6-bfbf420c465c-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-25796b95-51e3-4704-a2b6-bfbf420c465c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-25796b95-51e3-4704-a2b6-bfbf420c465c" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-25796b95-51e3-4704-a2b6-bfbf420c465c" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e57379-edb3-43dd-8f8c-9be133d8552e]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:39 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c" returned: 0 in 0.565s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 2G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:40 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c Apr 16 11:30:40 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 2G" returned: 0 in 0.071s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.655s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:40 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-16fc2745-8746-46bc-b876-94a4296986c3 tempest-VolumesExtendTest-1863419448 None] Extend volume completed successfully. Apr 16 11:30:40 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.532s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:40 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Deleted volume successfully. Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d05b87b5-3ff9-4d72-9c37-07acad0447db tempest-VolumesActionsTest-938360159 None] Lock "cinder-4c9636e0-437e-473d-89f7-f83e74ed9474-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:40 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:40 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c Apr 16 11:30:40 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "cinder-f1c7efa6-a9c1-40e2-83ba-873ff9085a70-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Lock "cinder-f1c7efa6-a9c1-40e2-83ba-873ff9085a70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "cinder-quobyte-a34f7749-fad2-4fd9-bd1e-0d23388a821c" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-a34f7749-fad2-4fd9-bd1e-0d23388a821c" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Acquiring lock "cinder-quobyte-f1c7efa6-a9c1-40e2-83ba-873ff9085a70" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-f1c7efa6-a9c1-40e2-83ba-873ff9085a70" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Deleting offline snapshot f1c7efa6-a9c1-40e2-83ba-873ff9085a70 of volume a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] snapshot_file for this snap is: volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da00cd0-1cdf-41cb-9400-26c9a6044ae4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:40 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 Apr 16 11:30:40 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:40 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-25796b95-51e3-4704-a2b6-bfbf420c465c" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-25796b95-51e3-4704-a2b6-bfbf420c465c" released by "delete_volume" :: held 1.071s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['a13331d1-0b21-467d-b7ce-27fc2bb572f4', 'b3c3e9cb-132c-4c40-9c75-ec12099cc9cc', '5d5817a9-f27f-4dcb-9917-40f5d71d1a2f', 'ed9ec8d0-cfb7-419f-9f22-6c4fe0b53e07'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:41 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:41 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:41 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70" returned: 0 in 0.574s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e741edfe-2e6d-4dc8-ad43-f0f7bdd006be]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:41 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c Apr 16 11:30:41 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:41 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.449s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:41 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Deleted volume successfully. Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e1f79e77-0a3e-4cfc-813b-7b0ce0c2c5cd tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-25796b95-51e3-4704-a2b6-bfbf420c465c-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:41 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c" returned: 0 in 0.496s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:41 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 Apr 16 11:30:41 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:42 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70" returned: 0 in 0.582s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:42 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70 Apr 16 11:30:42 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (82d7799c-eab3-45a3-8990-bf15b8d9834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4300e6-e188-4c51-82e9-62d9aba5f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4300e6-e188-4c51-82e9-62d9aba5f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1907767270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25e06a1-9cbb-49cb-a874-69072dffae7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:42Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d060adf1-5a1c-4687-93df-a50215793e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d060adf1-5a1c-4687-93df-a50215793e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14f3ff0-1c01-48a3-bca4-53da77a677c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14f3ff0-1c01-48a3-bca4-53da77a677c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25e06a1-9cbb-49cb-a874-69072dffae7c', 'volume_name': 'volume-d25e06a1-9cbb-49cb-a874-69072dffae7c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01898885-75b2-41d9-b499-8fea39ecb42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01898885-75b2-41d9-b499-8fea39ecb42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a378c5c-f1b5-4023-983f-944013474abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:42 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume d25e06a1-9cbb-49cb-a874-69072dffae7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25e06a1-9cbb-49cb-a874-69072dffae7c', 'volume_size': 1} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1907767270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25e06a1-9cbb-49cb-a874-69072dffae7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:42Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Creating volume d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:42 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:42 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c 1073741824 Apr 16 11:30:42 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:42 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c.f1c7efa6-a9c1-40e2-83ba-873ff9085a70" returned: 0 in 0.469s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-f1c7efa6-a9c1-40e2-83ba-873ff9085a70" released by "_delete_snapshot" :: held 2.196s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-a34f7749-fad2-4fd9-bd1e-0d23388a821c" released by "delete_snapshot" :: held 2.210s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Created reservations ['87012dd9-b8c8-4f1a-b624-e5f3ab4b889e', '0bc0f2f2-8052-4496-b615-df7110619121', '08f20517-d92d-44cc-9547-acad51136c9f', '8240b75e-ca44-4a55-a0b4-35caea5c53d2'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:42 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Delete snapshot completed successfully. Apr 16 11:30:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6ea228e-0616-42bb-a3a1-1f4202941af9 tempest-VolumesExtendTest-1863419448 None] Lock "cinder-f1c7efa6-a9c1-40e2-83ba-873ff9085a70-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:43 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c 1073741824" returned: 0 in 0.513s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:43 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c Apr 16 11:30:43 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:43 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c" returned: 0 in 0.434s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a378c5c-f1b5-4023-983f-944013474abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25e06a1-9cbb-49cb-a874-69072dffae7c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dac83fb-eb5e-4d29-87be-6ed66daf94fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:43 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Volume volume-d25e06a1-9cbb-49cb-a874-69072dffae7c (d25e06a1-9cbb-49cb-a874-69072dffae7c): created successfully Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dac83fb-eb5e-4d29-87be-6ed66daf94fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (82d7799c-eab3-45a3-8990-bf15b8d9834a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-24619a43-3826-4544-beab-c2dd4f15d209 tempest-VolumesSnapshotTestJSON-1549192242 None] Created volume successfully. Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Acquiring lock "cinder-a34f7749-fad2-4fd9-bd1e-0d23388a821c-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Lock "cinder-a34f7749-fad2-4fd9-bd1e-0d23388a821c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Acquiring lock "cinder-quobyte-a34f7749-fad2-4fd9-bd1e-0d23388a821c" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-a34f7749-fad2-4fd9-bd1e-0d23388a821c" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa245e5-5e1f-4078-a26f-37305a60ed7f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:43 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c Apr 16 11:30:43 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:44 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:44 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c Apr 16 11:30:44 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Creating offline snapshot 345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 of volume d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95f1bbf-e440-4a76-8862-782a3e64a2c5]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:44 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a34f7749-fad2-4fd9-bd1e-0d23388a821c" returned: 0 in 0.447s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Lock "cinder-quobyte-a34f7749-fad2-4fd9-bd1e-0d23388a821c" released by "delete_volume" :: held 0.970s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:44 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c Apr 16 11:30:44 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Created reservations ['e5491819-69d6-41ff-9c2a-2d7f4df8905a', '5432e8ea-b39f-43af-9463-689cdc99fadb', '3dade5ac-6729-4143-94a5-f359b9aff5f8', 'bbe28164-4715-4a65-a287-e324a91762eb'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:44 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:44 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:45 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c" returned: 0 in 0.504s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:45 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 1G Apr 16 11:30:45 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:45 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.430s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:45 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:45 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Deleted volume successfully. Apr 16 11:30:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4fc56989-ea23-48bf-bbc9-ae5948440f8b tempest-VolumesExtendTest-1863419448 None] Lock "cinder-a34f7749-fad2-4fd9-bd1e-0d23388a821c-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:45 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 1G" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d25e06a1-9cbb-49cb-a874-69072dffae7c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:45 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d25e06a1-9cbb-49cb-a874-69072dffae7c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 Apr 16 11:30:45 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:46 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d25e06a1-9cbb-49cb-a874-69072dffae7c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" returned: 0 in 0.508s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:46 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 is being set with open permissions: ugo+rw Apr 16 11:30:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:46 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 Apr 16 11:30:46 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:46 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" returned: 0 in 0.446s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:46 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.info Apr 16 11:30:46 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:47 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.info" returned: 0 in 0.514s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:47 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.info is being set with open permissions: ugo+rw Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:47 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.info Apr 16 11:30:47 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (faf53c12-f52a-47b2-9cf1-9dca28caff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f62f7a-0e24-4dc7-bd5f-ee8ad53d1931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f62f7a-0e24-4dc7-bd5f-ee8ad53d1931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1014943344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738145c2-0a90-4553-913b-cdd71161580e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:47Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9c2d59-7392-46bf-8b1b-991a955e8b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9c2d59-7392-46bf-8b1b-991a955e8b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbda7a45-2ed7-4725-8ed8-c9e708270535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbda7a45-2ed7-4725-8ed8-c9e708270535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738145c2-0a90-4553-913b-cdd71161580e', 'volume_name': 'volume-738145c2-0a90-4553-913b-cdd71161580e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4c0e32-553b-4b1a-97f7-7abff89f6321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4c0e32-553b-4b1a-97f7-7abff89f6321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed63593-beb5-47ad-ad39-e3b85c524300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Volume 738145c2-0a90-4553-913b-cdd71161580e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738145c2-0a90-4553-913b-cdd71161580e', 'volume_size': 1} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (662df0e9-aa9f-44ed-86c3-0028a6ff0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e76245-e859-4755-a1f7-3164f8a63455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e76245-e859-4755-a1f7-3164f8a63455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2069196450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317b567e-6fec-413f-a774-469dee966031,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:48Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9b7af-0c12-43b1-b527-f3ee57e50a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9b7af-0c12-43b1-b527-f3ee57e50a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5a779f-f01c-4ec5-8966-d6e2d413bed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5a779f-f01c-4ec5-8966-d6e2d413bed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317b567e-6fec-413f-a774-469dee966031', 'volume_name': 'volume-317b567e-6fec-413f-a774-469dee966031', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042e294d-eea7-4a8b-85ae-0b576554f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042e294d-eea7-4a8b-85ae-0b576554f30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a7566c-ecf9-4039-9d90-11890cc7d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:47 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Volume 317b567e-6fec-413f-a774-469dee966031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317b567e-6fec-413f-a774-469dee966031', 'volume_size': 1} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.info" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1014943344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738145c2-0a90-4553-913b-cdd71161580e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:47Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Creating volume 738145c2-0a90-4553-913b-cdd71161580e {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:47 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:47 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e 1073741824 Apr 16 11:30:47 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e1bb0660-8222-46c4-8436-20fe7e26b334 tempest-VolumesSnapshotTestJSON-1549192242 None] Create snapshot completed successfully Apr 16 11:30:48 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e 1073741824" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:48 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e Apr 16 11:30:48 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:48 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2069196450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317b567e-6fec-413f-a774-469dee966031,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:48Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Creating volume 317b567e-6fec-413f-a774-469dee966031 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:48 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed63593-beb5-47ad-ad39-e3b85c524300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738145c2-0a90-4553-913b-cdd71161580e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b057f74-45f8-4a0a-b34c-6750cadeba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:48 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 1073741824 Apr 16 11:30:48 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:48 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Volume volume-738145c2-0a90-4553-913b-cdd71161580e (738145c2-0a90-4553-913b-cdd71161580e): created successfully Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b057f74-45f8-4a0a-b34c-6750cadeba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (faf53c12-f52a-47b2-9cf1-9dca28caff2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:48 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dfda415f-2c1f-4b52-a2c8-7eb7e91b641a tempest-VolumesActionsTest-938360159 None] Created volume successfully. Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (618457ab-bf27-4b5f-ada8-ac8f35f180c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f95cf4-3c31-45d0-ad7b-a0c070f6ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f95cf4-3c31-45d0-ad7b-a0c070f6ea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-415869080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d52ef8-4647-4f5c-96f5-5d353cb063db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a978255d443219464350dc369faf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=345ac5ee-1e63-47dd-ba52-0ebc5979b7d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:49Z,use_quota=True,user_id='7c57477ceeb94e55a04414295130b3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7767f96-ccbc-4296-8ff3-b9f18236e9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7767f96-ccbc-4296-8ff3-b9f18236e9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64593a72-ae70-4f5d-9da3-01f97e1e69f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64593a72-ae70-4f5d-9da3-01f97e1e69f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15d52ef8-4647-4f5c-96f5-5d353cb063db', 'volume_name': 'volume-15d52ef8-4647-4f5c-96f5-5d353cb063db', 'volume_size': 1, 'snapshot_id': '345ac5ee-1e63-47dd-ba52-0ebc5979b7d5'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc01d3d-7e6c-4d1a-8f4d-df3d56620620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc01d3d-7e6c-4d1a-8f4d-df3d56620620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:49 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b17578-1196-4a28-89c8-a6b9eda23bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:49 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Volume 15d52ef8-4647-4f5c-96f5-5d353cb063db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15d52ef8-4647-4f5c-96f5-5d353cb063db', 'volume_size': 1, 'snapshot_id': '345ac5ee-1e63-47dd-ba52-0ebc5979b7d5'} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 1073741824" returned: 0 in 0.522s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:49 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 Apr 16 11:30:49 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-738145c2-0a90-4553-913b-cdd71161580e-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Lock "cinder-738145c2-0a90-4553-913b-cdd71161580e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-quobyte-738145c2-0a90-4553-913b-cdd71161580e" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-738145c2-0a90-4553-913b-cdd71161580e" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad0bc4-599c-43de-b119-8d77ec466835]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:49 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:49 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e Apr 16 11:30:49 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031" returned: 0 in 0.437s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.453s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5-15d52ef8-4647-4f5c-96f5-5d353cb063db" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a7566c-ecf9-4039-9d90-11890cc7d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317b567e-6fec-413f-a774-469dee966031', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bb1976-0987-439c-9ca9-96860286f35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5-15d52ef8-4647-4f5c-96f5-5d353cb063db" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Creating volume 15d52ef8-4647-4f5c-96f5-5d353cb063db from snapshot 345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-15d52ef8-4647-4f5c-96f5-5d353cb063db" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:49 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Volume volume-317b567e-6fec-413f-a774-469dee966031 (317b567e-6fec-413f-a774-469dee966031): created successfully Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bb1976-0987-439c-9ca9-96860286f35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (662df0e9-aa9f-44ed-86c3-0028a6ff0454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-15d52ef8-4647-4f5c-96f5-5d353cb063db" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] snapshot: 345ac5ee-1e63-47dd-ba52-0ebc5979b7d5, volume: 15d52ef8-4647-4f5c-96f5-5d353cb063db, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:30:49 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2cf343fb-2e21-40a1-842e-41ceefea69b8 tempest-VolumesGetTest-850842585 None] Created volume successfully. Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee550da-2163-45e8-a6cc-13a262914a10]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:49 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 Apr 16 11:30:49 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:50 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e" returned: 0 in 0.486s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:50 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e Apr 16 11:30:50 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:50 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (3a17ed32-9bd1-47cd-b555-25b48a3dd56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952c90b6-0acc-4ee0-bd21-0287f15e6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" returned: 0 in 0.568s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d25e06a1-9cbb-49cb-a874-69072dffae7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5867a-9176-47c3-9111-e2a71b71d7a1]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952c90b6-0acc-4ee0-bd21-0287f15e6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2063190277',display_name='tempest-VolumesGetTest-Volume-2019227471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151ac041-6d1d-427d-912a-85ef465ebb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:50Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c28d46-1cae-44b7-b120-597682cb4e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c28d46-1cae-44b7-b120-597682cb4e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0839c1-c332-4ccc-b82d-b4352daa087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0839c1-c332-4ccc-b82d-b4352daa087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151ac041-6d1d-427d-912a-85ef465ebb6f', 'volume_name': 'volume-151ac041-6d1d-427d-912a-85ef465ebb6f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7d1e44-8c32-4111-9197-76edca9a512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7d1e44-8c32-4111-9197-76edca9a512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d9e534-ec27-4b33-844b-5949ee0f80f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Volume 151ac041-6d1d-427d-912a-85ef465ebb6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151ac041-6d1d-427d-912a-85ef465ebb6f', 'volume_size': 1} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:50 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c Apr 16 11:30:50 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:50 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-738145c2-0a90-4553-913b-cdd71161580e" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-738145c2-0a90-4553-913b-cdd71161580e" released by "delete_volume" :: held 0.981s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Created reservations ['9c7b072b-2a82-44b8-b64f-a5bfd738889a', '5e7dc303-028d-4a39-98b2-77f4e3737a08', 'b2275062-4094-421a-ac4e-619eeba96919', '07482f94-8c25-43be-badf-436ae60b4089'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:50 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:50 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:50 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c" returned: 0 in 0.501s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:50 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db Apr 16 11:30:50 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (b83ef0c7-2177-4681-a4de-67e8769a4864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae448ab9-cdb2-4fee-a329-13cd858414d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae448ab9-cdb2-4fee-a329-13cd858414d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437709267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc2a754-442a-414d-9202-60d3d555e536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:51Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab78039-891a-4306-9376-e4bb13055b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab78039-891a-4306-9376-e4bb13055b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6056d71e-b192-404e-9437-e7b90d2c6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6056d71e-b192-404e-9437-e7b90d2c6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc2a754-442a-414d-9202-60d3d555e536', 'volume_name': 'volume-7bc2a754-442a-414d-9202-60d3d555e536', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a3f17d-bece-4bf9-b060-1b89813597fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a3f17d-bece-4bf9-b060-1b89813597fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f42e63-af22-4c29-9e25-4bf05c2269b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Volume 7bc2a754-442a-414d-9202-60d3d555e536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc2a754-442a-414d-9202-60d3d555e536', 'volume_size': 1} Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:51 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.460s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:51 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Deleted volume successfully. Apr 16 11:30:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-de213d09-f940-4d00-bd3b-82a8703d75af tempest-VolumesActionsTest-1426598202 None] Lock "cinder-738145c2-0a90-4553-913b-cdd71161580e-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:52 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db" returned: 0 in 2.012s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:52 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc4e5cd-fad3-44c8-91a6-4b1d52440484]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:52 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c Apr 16 11:30:52 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:53 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c" returned: 0 in 0.608s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:30:53 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Converted 1024.00 MB image at 508.81 MB/s Apr 16 11:30:53 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db is being set with open permissions: ugo+rw Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:53 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db Apr 16 11:30:53 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:53 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db" returned: 0 in 0.400s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-15d52ef8-4647-4f5c-96f5-5d353cb063db" released by "_copy_volume_from_snapshot" :: held 4.144s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5-15d52ef8-4647-4f5c-96f5-5d353cb063db" released by "_create_volume_from_snapshot" :: held 4.171s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.191s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2063190277',display_name='tempest-VolumesGetTest-Volume-2019227471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151ac041-6d1d-427d-912a-85ef465ebb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:50Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Creating volume 151ac041-6d1d-427d-912a-85ef465ebb6f {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:53 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:53 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f 1073741824 Apr 16 11:30:53 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b17578-1196-4a28-89c8-a6b9eda23bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d52ef8-4647-4f5c-96f5-5d353cb063db', 'volume_size': 1, 'snapshot_id': '345ac5ee-1e63-47dd-ba52-0ebc5979b7d5'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c55ef0-22c3-422a-b80f-b000239d92f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:53 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Volume volume-15d52ef8-4647-4f5c-96f5-5d353cb063db (15d52ef8-4647-4f5c-96f5-5d353cb063db): created successfully Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c55ef0-22c3-422a-b80f-b000239d92f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Flow 'volume_create_manager' (618457ab-bf27-4b5f-ada8-ac8f35f180c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8bd80066-31ad-4967-80bb-6ef08e4fcf8d tempest-VolumesSnapshotTestJSON-1549192242 None] Created volume successfully. Apr 16 11:30:54 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f 1073741824" returned: 0 in 0.492s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:54 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f Apr 16 11:30:54 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-15d52ef8-4647-4f5c-96f5-5d353cb063db-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-15d52ef8-4647-4f5c-96f5-5d353cb063db-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-15d52ef8-4647-4f5c-96f5-5d353cb063db" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-15d52ef8-4647-4f5c-96f5-5d353cb063db" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a07a6c8-00cc-444f-b548-b4743fcb69cd]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:54 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db Apr 16 11:30:54 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:54 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f" returned: 0 in 0.444s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.801s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437709267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc2a754-442a-414d-9202-60d3d555e536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:51Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Creating volume 7bc2a754-442a-414d-9202-60d3d555e536 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:54 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d9e534-ec27-4b33-844b-5949ee0f80f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151ac041-6d1d-427d-912a-85ef465ebb6f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:54 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 1073741824 Apr 16 11:30:54 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537437fc-bf2d-4932-b11b-936608bd6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:54 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Volume volume-151ac041-6d1d-427d-912a-85ef465ebb6f (151ac041-6d1d-427d-912a-85ef465ebb6f): created successfully Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537437fc-bf2d-4932-b11b-936608bd6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (3a17ed32-9bd1-47cd-b555-25b48a3dd56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7a410bb7-9dc8-4c98-99f9-0b2c0266f536 tempest-VolumesGetTest-850842585 None] Created volume successfully. Apr 16 11:30:54 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:55 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db Apr 16 11:30:55 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:55 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 1073741824" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:55 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 Apr 16 11:30:55 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:55 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-15d52ef8-4647-4f5c-96f5-5d353cb063db" returned: 0 in 0.448s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-15d52ef8-4647-4f5c-96f5-5d353cb063db" released by "delete_volume" :: held 0.951s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['846c8feb-a9da-4fa5-8270-16825f8390aa', '9fa297e9-d4b3-43fd-a4b4-0481d107f937', 'd806cf3d-e234-4611-8189-0aac0d14fff5', 'f6a26279-16c4-4b94-8d44-dcb020b597e8'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:55 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:55 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-151ac041-6d1d-427d-912a-85ef465ebb6f-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-d25e06a1-9cbb-49cb-a874-69072dffae7c" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Lock "cinder-151ac041-6d1d-427d-912a-85ef465ebb6f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-d25e06a1-9cbb-49cb-a874-69072dffae7c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Deleting offline snapshot 345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 of volume d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] snapshot_file for this snap is: volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca86f887-fe20-4cb4-adcf-719d0354b0a7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-151ac041-6d1d-427d-912a-85ef465ebb6f" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-151ac041-6d1d-427d-912a-85ef465ebb6f" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a803dc1-5be7-42a4-a393-c522eaa7955f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:55 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 Apr 16 11:30:55 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:55 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536" returned: 0 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f42e63-af22-4c29-9e25-4bf05c2269b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc2a754-442a-414d-9202-60d3d555e536', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892b4bb9-d8ee-458e-8e58-b03707057be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:55 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Volume volume-7bc2a754-442a-414d-9202-60d3d555e536 (7bc2a754-442a-414d-9202-60d3d555e536): created successfully Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892b4bb9-d8ee-458e-8e58-b03707057be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (b83ef0c7-2177-4681-a4de-67e8769a4864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:55 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f Apr 16 11:30:55 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:55 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4030cfaa-3544-41f2-a0af-4c16a3243765 tempest-VolumesActionsTest-938360159 None] Created volume successfully. Apr 16 11:30:56 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Deleted volume successfully. Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-025f0326-0a05-4a82-be51-b2ea51be61a6 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-15d52ef8-4647-4f5c-96f5-5d353cb063db-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:56 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" returned: 0 in 0.530s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d25e06a1-9cbb-49cb-a874-69072dffae7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[004fe3a6-1695-4f02-9c25-f196e7936295]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:56 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f" returned: 0 in 0.558s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:56 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f Apr 16 11:30:56 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:56 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c Apr 16 11:30:56 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-7bc2a754-442a-414d-9202-60d3d555e536-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Lock "cinder-7bc2a754-442a-414d-9202-60d3d555e536-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-quobyte-7bc2a754-442a-414d-9202-60d3d555e536" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-7bc2a754-442a-414d-9202-60d3d555e536" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[698df19e-2e90-4216-b0a4-8388837774db]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:56 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 Apr 16 11:30:56 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:56 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-151ac041-6d1d-427d-912a-85ef465ebb6f" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-151ac041-6d1d-427d-912a-85ef465ebb6f" released by "delete_volume" :: held 1.056s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:56 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c" returned: 0 in 0.565s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Created reservations ['13440c2c-848b-46db-a097-da08e2a77b4b', 'fe7e83be-fea8-477a-a4cd-f4eefd07d3ae', '25008887-c747-4b6a-aeab-c3dad5de4fa2', 'a7488d4e-1a19-475f-96b3-e5c295ae0a3c'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:56 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 Apr 16 11:30:56 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:56 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:56 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:56 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536" returned: 0 in 0.515s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:56 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536 Apr 16 11:30:56 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:57 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:57 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5 Apr 16 11:30:57 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:57 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.462s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Deleted volume successfully. Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7fe87cb5-5769-4822-b3ad-d199d886954e tempest-VolumesGetTest-850842585 None] Lock "cinder-151ac041-6d1d-427d-912a-85ef465ebb6f-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:57 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7bc2a754-442a-414d-9202-60d3d555e536" returned: 0 in 0.446s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-7bc2a754-442a-414d-9202-60d3d555e536" released by "delete_volume" :: held 0.984s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Created reservations ['6819a1de-cd6d-4632-abeb-02a10e1a665f', 'fd6e31df-7ab8-4958-9d93-8b17b895e5a2', 'c2bdfabd-c118-469f-b986-cce23c875a5f', '37687684-6d83-47fc-b36a-419156a2ab17'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:57 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:57 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:57 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c.345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (a5c4d331-0175-42fd-9599-ce766d4ffe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e65fc4b-d2a7-4482-b368-5b4178ea05dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5" released by "_delete_snapshot" :: held 2.143s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e65fc4b-d2a7-4482-b368-5b4178ea05dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1268011856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38311409-612c-49e2-9d60-ad8f5cff5bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:58Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b1733e-96ed-49a1-bb54-733aa611afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b1733e-96ed-49a1-bb54-733aa611afbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c86dc49-99fb-4008-8c9c-8a1b25927f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c86dc49-99fb-4008-8c9c-8a1b25927f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38311409-612c-49e2-9d60-ad8f5cff5bb5', 'volume_name': 'volume-38311409-612c-49e2-9d60-ad8f5cff5bb5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bd3b60-5539-46c9-a5c6-7704cd59d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bd3b60-5539-46c9-a5c6-7704cd59d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081626c7-3110-4ad2-8c7e-6ad8fe073a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:57 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Volume 38311409-612c-49e2-9d60-ad8f5cff5bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38311409-612c-49e2-9d60-ad8f5cff5bb5', 'volume_size': 1} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1268011856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38311409-612c-49e2-9d60-ad8f5cff5bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:30:58Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Creating volume 38311409-612c-49e2-9d60-ad8f5cff5bb5 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:30:57 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-d25e06a1-9cbb-49cb-a874-69072dffae7c" released by "delete_snapshot" :: held 2.223s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-317b567e-6fec-413f-a774-469dee966031-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:57 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 1073741824 Apr 16 11:30:57 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Lock "cinder-317b567e-6fec-413f-a774-469dee966031-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:57 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Deleted volume successfully. Apr 16 11:30:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-317b567e-6fec-413f-a774-469dee966031" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-317b567e-6fec-413f-a774-469dee966031" acquired by "delete_volume" :: waited 0.021s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7717190e-597b-48eb-812e-20d5a43e3c5c tempest-VolumesActionsTest-1426598202 None] Lock "cinder-7bc2a754-442a-414d-9202-60d3d555e536-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['14fa4780-bf25-47e0-ab78-75ac20382bf1', '3b8c92dd-66df-4217-ab38-ffb381cb4f7f', 'e06c1caa-ae75-402d-9c82-c0a53b31dc8c', '382d2662-77fd-4d76-b921-0344e05bda54'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fbc16b-8499-4098-9d2d-fa9596f6b4b2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Delete snapshot completed successfully. Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-49f730b6-d35f-4bb7-81ee-29eb8ff262e1 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-345ac5ee-1e63-47dd-ba52-0ebc5979b7d5-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:58 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 Apr 16 11:30:58 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:58 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 1073741824" returned: 0 in 0.513s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:58 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 Apr 16 11:30:58 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:58 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031" returned: 0 in 0.499s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:58 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031 Apr 16 11:30:58 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-d25e06a1-9cbb-49cb-a874-69072dffae7c-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-d25e06a1-9cbb-49cb-a874-69072dffae7c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:58 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5" returned: 0 in 0.499s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081626c7-3110-4ad2-8c7e-6ad8fe073a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38311409-612c-49e2-9d60-ad8f5cff5bb5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37274b5-03e1-416e-9ba9-cde80b1d012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:30:58 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Volume volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 (38311409-612c-49e2-9d60-ad8f5cff5bb5): created successfully Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37274b5-03e1-416e-9ba9-cde80b1d012b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (a5c4d331-0175-42fd-9599-ce766d4ffe10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-d25e06a1-9cbb-49cb-a874-69072dffae7c" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:30:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8dad74c7-047c-484b-bb60-1ba033f7ea5c tempest-VolumesActionsTest-938360159 None] Created volume successfully. Apr 16 11:30:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-d25e06a1-9cbb-49cb-a874-69072dffae7c" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:30:58 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-317b567e-6fec-413f-a774-469dee966031" returned: 0 in 0.474s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f998f99f-bc56-4164-a555-8dbcc483fdb3]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-317b567e-6fec-413f-a774-469dee966031" released by "delete_volume" :: held 1.013s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Created reservations ['d75bdc18-ce5e-44eb-b2c2-9cbfb32e9d9b', '3f8df656-a718-4d9b-8e2a-bca3dda1434e', '23de6011-3784-4923-ab0a-adce099ea117', 'fd8a07d3-543b-4330-b93c-51763175b93d'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:59 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c Apr 16 11:30:59 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:59 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:30:59 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:59 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:30:59 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c Apr 16 11:30:59 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:30:59 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.408s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:30:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Deleted volume successfully. Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4906ec78-a34f-4d5b-a99f-91b6e8c7c6c0 tempest-VolumesGetTest-850842585 None] Lock "cinder-317b567e-6fec-413f-a774-469dee966031-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:59 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d25e06a1-9cbb-49cb-a874-69072dffae7c" returned: 0 in 0.419s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-d25e06a1-9cbb-49cb-a874-69072dffae7c" released by "delete_volume" :: held 0.919s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['03f2f6b7-b5de-40b4-85c6-8edfefae17a9', '72e3cc69-820e-4d5d-950f-f103f3e4162f', '56dc7fa1-1933-44a9-abef-4b642e99f364', 'ef33692c-5002-4ced-9dac-9c0980b44e03'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:30:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:00 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:00 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-38311409-612c-49e2-9d60-ad8f5cff5bb5-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Lock "cinder-38311409-612c-49e2-9d60-ad8f5cff5bb5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-quobyte-38311409-612c-49e2-9d60-ad8f5cff5bb5" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-5caec68c-556c-4521-b217-96a0411285c5-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-38311409-612c-49e2-9d60-ad8f5cff5bb5" acquired by "delete_volume" :: waited 0.019s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-5caec68c-556c-4521-b217-96a0411285c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2103c6b-3384-4eef-bb12-ef945e292c8f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "cinder-quobyte-5caec68c-556c-4521-b217-96a0411285c5" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-5caec68c-556c-4521-b217-96a0411285c5" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d61deeb-0c3c-482b-ada3-186582a495ba]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:00 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 Apr 16 11:31:00 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (d18ba218-3f9c-42e4-9aa6-bdb6f416acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03da19a5-614f-497f-ae28-9edd3975e420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:00 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 Apr 16 11:31:00 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03da19a5-614f-497f-ae28-9edd3975e420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745900964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3328cbe1-41be-4f24-af97-2cc9c162a4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:00Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e46a12b-ee58-45a6-ae4b-94fbd84ad958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e46a12b-ee58-45a6-ae4b-94fbd84ad958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb9a46a-14e8-49ba-a322-985087d62e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb9a46a-14e8-49ba-a322-985087d62e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3328cbe1-41be-4f24-af97-2cc9c162a4b8', 'volume_name': 'volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969162a5-89c6-4cb2-9cf1-5e93df2e7ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969162a5-89c6-4cb2-9cf1-5e93df2e7ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0700df85-0a50-43f4-9aba-306af43bf922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:00 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Volume 3328cbe1-41be-4f24-af97-2cc9c162a4b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8', 'volume_size': 1} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745900964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3328cbe1-41be-4f24-af97-2cc9c162a4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:00Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Creating volume 3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:00 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:00 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 1073741824 Apr 16 11:31:00 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:00 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.495s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Deleted volume successfully. Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e6e27206-b117-4454-8e84-32cbcfdfa471 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-d25e06a1-9cbb-49cb-a874-69072dffae7c-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:00 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5" returned: 0 in 0.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:00 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5 Apr 16 11:31:00 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:00 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5" returned: 0 in 0.542s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:00 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5 Apr 16 11:31:00 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:00 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 1073741824" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:00 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 Apr 16 11:31:00 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:01 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-38311409-612c-49e2-9d60-ad8f5cff5bb5" returned: 0 in 0.440s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-38311409-612c-49e2-9d60-ad8f5cff5bb5" released by "delete_volume" :: held 1.038s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Created reservations ['e0cda7c4-d9a4-4ffc-8d99-99efaeba1449', '1e34ac8d-5adf-4a36-a6a1-c9ee652b309b', 'bc0de3ec-a627-48f5-8cc5-dbf7fd6b4be1', '06be9fb5-12d2-4716-9a81-5c878ad2ce75'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:01 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-5caec68c-556c-4521-b217-96a0411285c5" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-quobyte-5caec68c-556c-4521-b217-96a0411285c5" released by "delete_volume" :: held 1.040s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Created reservations ['54a6e80c-1791-49b3-97d9-9700b4ae2c72', '6a201b33-412e-421e-82a0-0765a8ee5de6', '444f8a6e-b22b-4b1d-a4fe-9a64e7f92e11', '5b1c30b0-5388-4db1-95aa-90031b24145e'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:01 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:01 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:01 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8" returned: 0 in 0.430s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0700df85-0a50-43f4-9aba-306af43bf922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:01 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:01 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ccb077-89d7-4d6b-ab76-8be8b3dde98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:01 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Volume volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 (3328cbe1-41be-4f24-af97-2cc9c162a4b8): created successfully Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ccb077-89d7-4d6b-ab76-8be8b3dde98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (d18ba218-3f9c-42e4-9aa6-bdb6f416acbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:01 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a578acae-58a7-4481-a7d3-deeb8852b697 tempest-VolumesGetTest-850842585 None] Created volume successfully. Apr 16 11:31:01 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.402s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:01 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Deleted volume successfully. Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-77d7d9bf-44f7-4aa2-9dfb-c8e878c3190b tempest-VolumesActionsTest-1426598202 None] Lock "cinder-38311409-612c-49e2-9d60-ad8f5cff5bb5-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:01 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.408s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:01 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Deleted volume successfully. Apr 16 11:31:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-58bef61a-4795-4f72-a93d-c5d3e9f8f1f3 tempest-VolumesSnapshotTestJSON-1549192242 None] Lock "cinder-5caec68c-556c-4521-b217-96a0411285c5-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (4585efee-5905-49f8-8aef-5ff5756b26d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b35fb3-70bb-4ec9-bf68-d13d5f4b2572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b35fb3-70bb-4ec9-bf68-d13d5f4b2572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1644941924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9d4739-0f9e-4985-b72b-097e53039416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:02Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445ff4e9-c9bf-4c62-a5db-07557812d584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445ff4e9-c9bf-4c62-a5db-07557812d584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf5116-6292-4ff1-88ee-4dcaf30530ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf5116-6292-4ff1-88ee-4dcaf30530ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9d4739-0f9e-4985-b72b-097e53039416', 'volume_name': 'volume-bf9d4739-0f9e-4985-b72b-097e53039416', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5a974f-d861-4c17-826a-7fefa0b90017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5a974f-d861-4c17-826a-7fefa0b90017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806fdc86-cfd7-4797-abc8-3775e84801db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Volume bf9d4739-0f9e-4985-b72b-097e53039416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9d4739-0f9e-4985-b72b-097e53039416', 'volume_size': 1} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1644941924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9d4739-0f9e-4985-b72b-097e53039416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:02Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Creating volume bf9d4739-0f9e-4985-b72b-097e53039416 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:02 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:02 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 1073741824 Apr 16 11:31:02 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (50423bce-8453-4d5d-b192-8e817db4d773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7f4451-d697-4f48-9b1a-884d2739d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7f4451-d697-4f48-9b1a-884d2739d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-309626621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd6839d-0afc-4feb-b4a1-040f2659d3b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3328cbe1-41be-4f24-af97-2cc9c162a4b8,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:03Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da036b12-6fa5-4ed4-8b96-0a2e06a06d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da036b12-6fa5-4ed4-8b96-0a2e06a06d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefb2441-ccc2-45e5-a2d1-32a243298b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefb2441-ccc2-45e5-a2d1-32a243298b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0bd6839d-0afc-4feb-b4a1-040f2659d3b5', 'volume_name': 'volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5', 'volume_size': 1, 'source_volid': '3328cbe1-41be-4f24-af97-2cc9c162a4b8', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a4866f-52c6-4c78-8136-1142250d4a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a4866f-52c6-4c78-8136-1142250d4a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac4c3d5-2028-4a2d-810e-ec802b879678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:02 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Volume 0bd6839d-0afc-4feb-b4a1-040f2659d3b5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5', 'volume_size': 1, 'source_volid': '3328cbe1-41be-4f24-af97-2cc9c162a4b8', 'source_volstatus': 'available'} Apr 16 11:31:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:03 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 1073741824" returned: 0 in 0.549s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:03 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 Apr 16 11:31:03 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:03 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.740s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:03 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Cloning volume 3328cbe1-41be-4f24-af97-2cc9c162a4b8 to volume 0bd6839d-0afc-4feb-b4a1-040f2659d3b5 Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806fdc86-cfd7-4797-abc8-3775e84801db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9d4739-0f9e-4985-b72b-097e53039416', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f2c1ba-ddb6-42b3-9fab-481b70524f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:03 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Volume volume-bf9d4739-0f9e-4985-b72b-097e53039416 (bf9d4739-0f9e-4985-b72b-097e53039416): created successfully Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f2c1ba-ddb6-42b3-9fab-481b70524f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (4585efee-5905-49f8-8aef-5ff5756b26d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Creating offline snapshot 6e1fff39-9815-4f29-8e48-41458b2afb09 of volume 3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:31:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-db779b4e-4048-4365-b45d-6a6e8d45bd59 tempest-VolumesActionsTest-938360159 None] Created volume successfully. Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e6bd57-ef95-43e1-af68-0013f89870b9]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:03 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 Apr 16 11:31:03 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:04 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8" returned: 0 in 0.497s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:04 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 1G Apr 16 11:31:04 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:04 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 1G" returned: 0 in 0.532s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:04 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 Apr 16 11:31:04 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-bf9d4739-0f9e-4985-b72b-097e53039416-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Lock "cinder-bf9d4739-0f9e-4985-b72b-097e53039416-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Acquiring lock "cinder-quobyte-bf9d4739-0f9e-4985-b72b-097e53039416" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-bf9d4739-0f9e-4985-b72b-097e53039416" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128ad55-fb2e-477c-95fb-b43ec093b522]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:04 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 Apr 16 11:31:04 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:05 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09" returned: 0 in 0.512s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:05 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 is being set with open permissions: ugo+rw Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:05 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 Apr 16 11:31:05 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:05 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416" returned: 0 in 0.524s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:05 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416 Apr 16 11:31:05 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:05 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09" returned: 0 in 0.421s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:05 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.info Apr 16 11:31:05 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:05 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-bf9d4739-0f9e-4985-b72b-097e53039416" returned: 0 in 0.493s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Lock "cinder-quobyte-bf9d4739-0f9e-4985-b72b-097e53039416" released by "delete_volume" :: held 1.047s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Created reservations ['582264ac-78a2-4aaf-bd6f-7d7632c4e499', '24115e4d-51ef-4e0a-b73a-cdf6254e624e', '3d158a83-68f0-425a-8bd7-baf0c0044954', 'f66f55c5-38eb-4cd9-8fda-5f1d0406d384'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:06 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:06 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:06 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.info" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:06 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.info is being set with open permissions: ugo+rw Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:06 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.info Apr 16 11:31:06 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (49ea94c5-d31f-4564-bb70-93bbafff4da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efd3b99-cf94-463f-b105-4e9be9d4e726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efd3b99-cf94-463f-b105-4e9be9d4e726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-907827251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0084f1c8-6dde-4ae5-ad65-b2ed420b818f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a6b60c5b984b5f9aee0ea88cf5189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:06Z,use_quota=True,user_id='6d230de7ab3a43eca27449ca4daa8a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65fb9a9-75df-409c-9d40-8ef24f59b2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65fb9a9-75df-409c-9d40-8ef24f59b2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5ab67-67ca-4ca5-b8fc-01321357cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5ab67-67ca-4ca5-b8fc-01321357cc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0084f1c8-6dde-4ae5-ad65-b2ed420b818f', 'volume_name': 'volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3f1ded-0b11-4abc-aa4a-cb39b3459c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3f1ded-0b11-4abc-aa4a-cb39b3459c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead311d8-ebc4-462a-8b2c-8e2cdf7ea320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:06 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Volume 0084f1c8-6dde-4ae5-ad65-b2ed420b818f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f', 'volume_size': 1} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:06 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.454s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:06 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Deleted volume successfully. Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a917e13e-e9b5-486d-853f-8da1b010ec76 tempest-VolumesActionsTest-1426598202 None] Lock "cinder-bf9d4739-0f9e-4985-b72b-097e53039416-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:06 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.info" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] snapshot: 6e1fff39-9815-4f29-8e48-41458b2afb09, volume: 0bd6839d-0afc-4feb-b4a1-040f2659d3b5, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab37cea-903d-455d-b3ab-d9ef46b66e0b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:06 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 Apr 16 11:31:06 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:07 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8387844e-9023-42aa-806f-18b4dad82f25]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:07 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 Apr 16 11:31:07 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=183,cinder:UPDATE=211,cinder:INSERT=48,cinder:DELETE=15 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=163,cinder:INSERT=63,cinder:UPDATE=201,cinder:DELETE=20 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (563f7cd9-62a0-4dbc-93bf-2fc6548e700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07b671f-7196-4cb9-89b1-4b2bd4a7054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07b671f-7196-4cb9-89b1-4b2bd4a7054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049299734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7699727-dde6-4106-b010-5c7e1a6bdf74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:07Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035f6eb4-c90c-4ceb-815c-495cddbc6d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035f6eb4-c90c-4ceb-815c-495cddbc6d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fa576a-8cd3-47ec-b105-8f8eb863c30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fa576a-8cd3-47ec-b105-8f8eb863c30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7699727-dde6-4106-b010-5c7e1a6bdf74', 'volume_name': 'volume-b7699727-dde6-4106-b010-5c7e1a6bdf74', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a56f9-4129-4cf9-84f6-9ba42986e8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a56f9-4129-4cf9-84f6-9ba42986e8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87aa3814-acae-4746-9253-84efa550c6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:07 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Volume b7699727-dde6-4106-b010-5c7e1a6bdf74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7699727-dde6-4106-b010-5c7e1a6bdf74', 'volume_size': 1} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:07 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:31:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:07 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 Apr 16 11:31:07 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:09 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" returned: 0 in 1.954s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[252c8f5b-e770-45f7-b822-8be1a1bd26b3]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:09 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 Apr 16 11:31:09 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:10 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8" returned: 0 in 0.582s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:31:10 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Converted 1024.00 MB image at 523.75 MB/s Apr 16 11:31:10 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 is being set with open permissions: ugo+rw Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:10 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 Apr 16 11:31:10 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:10 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" returned: 0 in 0.421s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" released by "_copy_volume_from_snapshot" :: held 3.973s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-6e1fff39-9815-4f29-8e48-41458b2afb09" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-6e1fff39-9815-4f29-8e48-41458b2afb09" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Deleting offline snapshot 6e1fff39-9815-4f29-8e48-41458b2afb09 of volume 3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] snapshot_file for this snap is: volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc8b3d7-e160-461d-b764-d75e20f6010a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:10 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 Apr 16 11:31:10 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:10 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:10 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:11 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09" returned: 0 in 0.453s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa3b19d-7d53-48d9-a808-043d713eff14]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:11 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 Apr 16 11:31:11 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.431s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:11 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:11 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:11 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 Apr 16 11:31:11 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:11 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09" returned: 0 in 0.455s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:11 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09 Apr 16 11:31:11 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:12 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8.6e1fff39-9815-4f29-8e48-41458b2afb09" returned: 0 in 0.396s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-6e1fff39-9815-4f29-8e48-41458b2afb09" released by "_delete_snapshot" :: held 1.835s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.790s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.105s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-907827251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0084f1c8-6dde-4ae5-ad65-b2ed420b818f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a6b60c5b984b5f9aee0ea88cf5189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:06Z,use_quota=True,user_id='6d230de7ab3a43eca27449ca4daa8a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Creating volume 0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:12 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:12 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f 1073741824 Apr 16 11:31:12 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac4c3d5-2028-4a2d-810e-ec802b879678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5', 'volume_size': 1, 'source_volid': '3328cbe1-41be-4f24-af97-2cc9c162a4b8', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17818564-48c5-47a8-8b9b-e70e617acd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:12 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Volume volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 (0bd6839d-0afc-4feb-b4a1-040f2659d3b5): created successfully Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17818564-48c5-47a8-8b9b-e70e617acd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (50423bce-8453-4d5d-b192-8e817db4d773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:12 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-db7715f5-842c-4759-a381-85578b2fc4ef tempest-VolumesGetTest-850842585 None] Created volume successfully. Apr 16 11:31:12 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f 1073741824" returned: 0 in 0.474s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:12 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f Apr 16 11:31:12 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:13 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" returned: 0 in 0.400s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.027s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049299734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7699727-dde6-4106-b010-5c7e1a6bdf74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d53061c7862478dbff8678c8dbd8a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:07Z,use_quota=True,user_id='41f61f30924e4fb58a4b9c8d98d85e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Creating volume b7699727-dde6-4106-b010-5c7e1a6bdf74 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:13 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead311d8-ebc4-462a-8b2c-8e2cdf7ea320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2f4947-2cfd-4a54-bfd3-a8ed1444d980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:13 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 1073741824 Apr 16 11:31:13 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:13 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Volume volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f (0084f1c8-6dde-4ae5-ad65-b2ed420b818f): created successfully Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2f4947-2cfd-4a54-bfd3-a8ed1444d980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (49ea94c5-d31f-4564-bb70-93bbafff4da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:13 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dbf288ba-2479-4cbd-bc69-f2349efa6879 tempest-VolumeDependencyTests-634339314 None] Created volume successfully. Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:13 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (fd435ba6-c9ed-4e39-84a3-a071f7289b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c55553-5e9b-4f31-a50f-81da6402b9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 1073741824" returned: 0 in 0.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c55553-5e9b-4f31-a50f-81da6402b9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-649002445',display_name='tempest-VolumesGetTest-Volume-1933254797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a23414f-1cd0-40db-9506-9aacc2a463da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:14Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7e8690-4473-4a7a-9dcd-e8d742810eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7e8690-4473-4a7a-9dcd-e8d742810eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3778c9bc-2fa0-4bcd-b24d-71698a394d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3778c9bc-2fa0-4bcd-b24d-71698a394d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a23414f-1cd0-40db-9506-9aacc2a463da', 'volume_name': 'volume-4a23414f-1cd0-40db-9506-9aacc2a463da', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f08ce2a-2554-46de-85b7-3e94549a5709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f08ce2a-2554-46de-85b7-3e94549a5709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7951b86d-4a28-4908-be47-579d39f3261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:13 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Volume 4a23414f-1cd0-40db-9506-9aacc2a463da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a23414f-1cd0-40db-9506-9aacc2a463da', 'volume_size': 1} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:13 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 Apr 16 11:31:13 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:14 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.549s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87aa3814-acae-4746-9253-84efa550c6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7699727-dde6-4106-b010-5c7e1a6bdf74', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faea5ab-7fd2-4e17-b454-15325fb2d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Creating offline snapshot b848e24f-c022-4b18-be63-d19fa9059179 of volume 0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:31:14 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Volume volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 (b7699727-dde6-4106-b010-5c7e1a6bdf74): created successfully Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faea5ab-7fd2-4e17-b454-15325fb2d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Flow 'volume_create_manager' (563f7cd9-62a0-4dbc-93bf-2fc6548e700e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c887c316-5919-4a4c-b7dc-e8013fb3576d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-32ec11d5-1c95-4701-921a-28235a2381e5 tempest-VolumesActionsTest-938360159 None] Created volume successfully. Apr 16 11:31:14 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f Apr 16 11:31:14 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:14 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" returned: 0 in 0.491s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:14 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 1G Apr 16 11:31:14 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Acquiring lock "cinder-b7699727-dde6-4106-b010-5c7e1a6bdf74-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Lock "cinder-b7699727-dde6-4106-b010-5c7e1a6bdf74-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Acquiring lock "cinder-quobyte-b7699727-dde6-4106-b010-5c7e1a6bdf74" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Lock "cinder-quobyte-b7699727-dde6-4106-b010-5c7e1a6bdf74" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e819529-1006-4b73-8e7c-6053bfc513f0]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:15 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 Apr 16 11:31:15 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:15 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 1G" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:15 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 Apr 16 11:31:15 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:15 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:15 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74 Apr 16 11:31:15 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:15 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179" returned: 0 in 0.423s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:15 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 is being set with open permissions: ugo+rw Apr 16 11:31:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:15 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 Apr 16 11:31:15 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:16 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b7699727-dde6-4106-b010-5c7e1a6bdf74" returned: 0 in 0.422s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Lock "cinder-quobyte-b7699727-dde6-4106-b010-5c7e1a6bdf74" released by "delete_volume" :: held 0.932s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Created reservations ['1c3975b6-ab99-4c12-8c05-a0f92ff6ec04', '98ee3aa2-f516-4783-a85b-906e9eaf3370', '69c1c507-1590-42d3-8ce3-84837ddd4d95', '7a21c352-675a-4eae-a48a-d6d1ccacf4e7'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:16 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:16 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:16 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179" returned: 0 in 0.455s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:16 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.info Apr 16 11:31:16 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:16 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Deleted volume successfully. Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e0170490-edc9-4cc4-81df-cab85280efa8 tempest-VolumesActionsTest-938360159 None] Lock "cinder-b7699727-dde6-4106-b010-5c7e1a6bdf74-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:16 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.info" returned: 0 in 0.474s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:16 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.info is being set with open permissions: ugo+rw Apr 16 11:31:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:16 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.info Apr 16 11:31:16 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:17 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.info" returned: 0 in 0.429s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.837s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.275s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-649002445',display_name='tempest-VolumesGetTest-Volume-1933254797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a23414f-1cd0-40db-9506-9aacc2a463da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:14Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Creating volume 4a23414f-1cd0-40db-9506-9aacc2a463da {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:17 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:17 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-967fd3ed-bcfe-41fe-96d9-f6c6c43a6ea2 tempest-VolumeDependencyTests-634339314 None] Create snapshot completed successfully Apr 16 11:31:17 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da 1073741824 Apr 16 11:31:17 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:17 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da 1073741824" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:17 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da Apr 16 11:31:17 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:18 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da" returned: 0 in 0.498s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7951b86d-4a28-4908-be47-579d39f3261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a23414f-1cd0-40db-9506-9aacc2a463da', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165d9ae9-d5a0-4f13-860f-4e05a8c9f14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:18 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Volume volume-4a23414f-1cd0-40db-9506-9aacc2a463da (4a23414f-1cd0-40db-9506-9aacc2a463da): created successfully Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165d9ae9-d5a0-4f13-860f-4e05a8c9f14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (fd435ba6-c9ed-4e39-84a3-a071f7289b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ddb4a9ca-a693-4b2d-bf48-1584ba356f61 tempest-VolumesGetTest-850842585 None] Created volume successfully. Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (b01e4aac-5c75-45d5-b2ba-765495d435b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ff3f5-63ac-4ae5-b8d6-137655f457ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ff3f5-63ac-4ae5-b8d6-137655f457ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1555568681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35639b1b-1168-402a-b410-c319eccf8002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a6b60c5b984b5f9aee0ea88cf5189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b848e24f-c022-4b18-be63-d19fa9059179,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:18Z,use_quota=True,user_id='6d230de7ab3a43eca27449ca4daa8a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d27758-4727-482c-a97c-51da1834c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d27758-4727-482c-a97c-51da1834c92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fab1ddb-1ee6-488d-8117-01e3124e9194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fab1ddb-1ee6-488d-8117-01e3124e9194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35639b1b-1168-402a-b410-c319eccf8002', 'volume_name': 'volume-35639b1b-1168-402a-b410-c319eccf8002', 'volume_size': 1, 'snapshot_id': 'b848e24f-c022-4b18-be63-d19fa9059179'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7beff5-35ad-4ec2-b814-883a576ce326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7beff5-35ad-4ec2-b814-883a576ce326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7153725-3b95-41b9-a3b3-dcb89376fcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:18 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Volume 35639b1b-1168-402a-b410-c319eccf8002: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35639b1b-1168-402a-b410-c319eccf8002', 'volume_size': 1, 'snapshot_id': 'b848e24f-c022-4b18-be63-d19fa9059179'} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-b848e24f-c022-4b18-be63-d19fa9059179-35639b1b-1168-402a-b410-c319eccf8002" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-b848e24f-c022-4b18-be63-d19fa9059179-35639b1b-1168-402a-b410-c319eccf8002" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Creating volume 35639b1b-1168-402a-b410-c319eccf8002 from snapshot b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-35639b1b-1168-402a-b410-c319eccf8002" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-35639b1b-1168-402a-b410-c319eccf8002" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] snapshot: b848e24f-c022-4b18-be63-d19fa9059179, volume: 35639b1b-1168-402a-b410-c319eccf8002, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6881519-b0cb-4827-bb85-1556fa78ca9f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:18 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 Apr 16 11:31:18 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:18 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179" returned: 0 in 0.518s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90fb6d4-22ac-43ca-a98e-b5b0a8d18616]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:18 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f Apr 16 11:31:18 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-4a23414f-1cd0-40db-9506-9aacc2a463da-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Lock "cinder-4a23414f-1cd0-40db-9506-9aacc2a463da-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-4a23414f-1cd0-40db-9506-9aacc2a463da" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-4a23414f-1cd0-40db-9506-9aacc2a463da" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd8ce3-c79c-4068-9e7b-144598e9d213]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:19 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da Apr 16 11:31:19 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:19 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" returned: 0 in 0.524s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:19 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 Apr 16 11:31:19 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:19 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da" returned: 0 in 0.560s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:19 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da Apr 16 11:31:19 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:20 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4a23414f-1cd0-40db-9506-9aacc2a463da" returned: 0 in 0.895s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-4a23414f-1cd0-40db-9506-9aacc2a463da" released by "delete_volume" :: held 1.482s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Created reservations ['c8fd3449-32ff-4f89-81be-b7078424c1a3', 'b0e7b5fd-7015-4050-bd24-b0c11d942a63', '21b74165-41e6-4cca-8363-5300dec5a47a', '685ab417-f88f-40e6-acee-8b0cb52ff572'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:20 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:20 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-0bd6839d-0afc-4feb-b4a1-040f2659d3b5-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Lock "cinder-0bd6839d-0afc-4feb-b4a1-040f2659d3b5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf82999-211b-4f03-9c5a-8b6976aacf5d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:21 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002" returned: 0 in 2.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb67b0cc-1d90-493d-8b4c-3bdf429b86ba]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:21 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.027s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:21 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Deleted volume successfully. Apr 16 11:31:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-cbbb0692-921e-4ed1-8587-ebc23839f28c tempest-VolumesGetTest-850842585 None] Lock "cinder-4a23414f-1cd0-40db-9506-9aacc2a463da-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:21 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 Apr 16 11:31:21 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:21 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f Apr 16 11:31:21 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:22 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" returned: 0 in 0.565s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:22 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5 Apr 16 11:31:22 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:22 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" returned: 0 in 0.713s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:31:22 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Converted 1024.00 MB image at 415.40 MB/s Apr 16 11:31:22 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 is being set with open permissions: ugo+rw Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:22 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 Apr 16 11:31:22 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:22 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-0bd6839d-0afc-4feb-b4a1-040f2659d3b5" released by "delete_volume" :: held 1.069s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Created reservations ['0739c0eb-3d55-4c5a-9510-e8f43d139d02', 'b0f050ca-0986-4f23-966c-7fb0b4b91713', 'd6619ea1-7f62-4f9b-a652-f206971a8e36', '2874efdb-b4e1-46e9-b88e-5337fdd8e9f0'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:23 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:23 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:23 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002" returned: 0 in 0.486s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-35639b1b-1168-402a-b410-c319eccf8002" released by "_copy_volume_from_snapshot" :: held 4.757s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-b848e24f-c022-4b18-be63-d19fa9059179-35639b1b-1168-402a-b410-c319eccf8002" released by "_create_volume_from_snapshot" :: held 4.771s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.778s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7153725-3b95-41b9-a3b3-dcb89376fcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35639b1b-1168-402a-b410-c319eccf8002', 'volume_size': 1, 'snapshot_id': 'b848e24f-c022-4b18-be63-d19fa9059179'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acb9eaa-806f-4069-b09b-344466f63077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:23 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Volume volume-35639b1b-1168-402a-b410-c319eccf8002 (35639b1b-1168-402a-b410-c319eccf8002): created successfully Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acb9eaa-806f-4069-b09b-344466f63077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (b01e4aac-5c75-45d5-b2ba-765495d435b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc91f3e4-e3a0-4265-881b-c2e4a6b27296 tempest-VolumeDependencyTests-634339314 None] Created volume successfully. Apr 16 11:31:23 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:23 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Deleted volume successfully. Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6e5a68d-a2b5-4531-9a97-021f4eb12c73 tempest-VolumesGetTest-850842585 None] Lock "cinder-0bd6839d-0afc-4feb-b4a1-040f2659d3b5-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-b848e24f-c022-4b18-be63-d19fa9059179-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-b848e24f-c022-4b18-be63-d19fa9059179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-b848e24f-c022-4b18-be63-d19fa9059179" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-b848e24f-c022-4b18-be63-d19fa9059179" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Deleting offline snapshot b848e24f-c022-4b18-be63-d19fa9059179 of volume 0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] snapshot_file for this snap is: volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8fa869-0d2a-4c65-98ce-fdb089c4574d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:23 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 Apr 16 11:31:23 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Flow 'volume_create_manager' (4c13cf46-0653-4de5-bd5d-8836d23db54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482d649d-84b8-481f-b4ed-942298433965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-3328cbe1-41be-4f24-af97-2cc9c162a4b8-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482d649d-84b8-481f-b4ed-942298433965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2010331660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fc1a64-9a22-4c8e-86b3-a7eb0147f91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c031e30a7734cd3b5c82859ff757b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:24Z,use_quota=True,user_id='860f28b24c264662a2fba44124ade26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4286a551-1798-4117-95bf-4fd7481d8afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4286a551-1798-4117-95bf-4fd7481d8afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d34e36c-f40f-4f70-88b7-a6516da4800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d34e36c-f40f-4f70-88b7-a6516da4800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fc1a64-9a22-4c8e-86b3-a7eb0147f91e', 'volume_name': 'volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3883e84a-d808-4e96-a0cc-f0e40b222680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3883e84a-d808-4e96-a0cc-f0e40b222680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bba7a03-44b8-4afb-b5d4-8318dc9d818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:24 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Volume 81fc1a64-9a22-4c8e-86b3-a7eb0147f91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e', 'volume_size': 1} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2010331660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fc1a64-9a22-4c8e-86b3-a7eb0147f91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c031e30a7734cd3b5c82859ff757b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:24Z,use_quota=True,user_id='860f28b24c264662a2fba44124ade26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Creating volume 81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:24 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Lock "cinder-3328cbe1-41be-4f24-af97-2cc9c162a4b8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:24 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e 1073741824 Apr 16 11:31:24 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-3328cbe1-41be-4f24-af97-2cc9c162a4b8" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-3328cbe1-41be-4f24-af97-2cc9c162a4b8" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6aed7-31f9-4e8a-95a9-312ea46a9adc]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:24 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 Apr 16 11:31:24 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:24 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179" returned: 0 in 0.513s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a7ea7-bfff-43e8-af35-19bacfc25353]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:24 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f Apr 16 11:31:24 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:24 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e 1073741824" returned: 0 in 0.503s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:24 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e Apr 16 11:31:24 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:24 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8" returned: 0 in 0.499s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:24 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8 Apr 16 11:31:24 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:24 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" returned: 0 in 0.504s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:24 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 Apr 16 11:31:24 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:25 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bba7a03-44b8-4afb-b5d4-8318dc9d818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ac4550-82b7-4084-af96-b3ed8fab55f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:25 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Volume volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e (81fc1a64-9a22-4c8e-86b3-a7eb0147f91e): created successfully Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ac4550-82b7-4084-af96-b3ed8fab55f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Flow 'volume_create_manager' (4c13cf46-0653-4de5-bd5d-8836d23db54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:25 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-53694ff2-b917-4759-b905-f7596e4aabd4 tempest-VolumesDeleteCascade-1060559744 None] Created volume successfully. Apr 16 11:31:25 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3328cbe1-41be-4f24-af97-2cc9c162a4b8" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-3328cbe1-41be-4f24-af97-2cc9c162a4b8" released by "delete_volume" :: held 0.984s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Created reservations ['31c9eb16-2ed8-449f-88e2-97a9d2264e74', '69d80528-1a7e-4381-8b7e-9f1c6695b5e4', '4e32ee79-cf7e-405f-980e-ca1fd8933884', '124e5412-fe2c-4199-9d5e-93e6e275d7dd'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:25 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:25 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:25 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179" returned: 0 in 0.481s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:25 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179 Apr 16 11:31:25 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:25 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:25 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Deleted volume successfully. Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d567548a-2d29-493a-a24c-f292da8fd3e5 tempest-VolumesGetTest-850842585 None] Lock "cinder-3328cbe1-41be-4f24-af97-2cc9c162a4b8-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:25 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f.b848e24f-c022-4b18-be63-d19fa9059179" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-b848e24f-c022-4b18-be63-d19fa9059179" released by "_delete_snapshot" :: held 1.953s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" released by "delete_snapshot" :: held 1.963s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Created reservations ['7eebbc52-3569-4624-a1d2-0bb2005972e0', '194bb485-ef9e-448d-b86e-78e5311f6719', '6c8fd9b6-def7-4ae6-abaf-dc623a1f8678', 'cc0a7080-49ea-4fda-874e-e0d1ed6bb43d'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:25 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Delete snapshot completed successfully. Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47361c9e-66c6-4e87-ab7d-2e513ef1eaf0 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-b848e24f-c022-4b18-be63-d19fa9059179-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-0084f1c8-6dde-4ae5-ad65-b2ed420b818f-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Lock "cinder-0084f1c8-6dde-4ae5-ad65-b2ed420b818f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[86afccad-e158-4d43-9956-1dbafc4bbbf5]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:26 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f Apr 16 11:31:26 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Creating offline snapshot e5a4a4e1-625a-4193-9da3-83ee7533ce57 of volume 81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1033d3-fdbd-483e-a1b8-7d78f279436d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:26 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e Apr 16 11:31:26 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:26 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" returned: 0 in 0.532s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:26 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f Apr 16 11:31:26 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (b074bf08-b9ba-4286-8820-9567af372689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fb9c6c-ac4e-4781-aa4d-ce0f7d9a8abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fb9c6c-ac4e-4781-aa4d-ce0f7d9a8abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754952029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02980952-1c34-4df0-908d-d0894a464d4a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:27Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d678ae09-827c-495f-868c-363e0a8ab5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d678ae09-827c-495f-868c-363e0a8ab5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3716f7cc-47fc-4514-bf73-04e91aa0f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.image.glance [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Creating Keystone auth plugin from conf {{(pid=83804) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 11:31:26 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:26 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 1G Apr 16 11:31:26 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3716f7cc-47fc-4514-bf73-04e91aa0f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02980952-1c34-4df0-908d-d0894a464d4a', 'volume_name': 'volume-02980952-1c34-4df0-908d-d0894a464d4a', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ed507c-2475-4a07-85e0-72632a9ee32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ed507c-2475-4a07-85e0-72632a9ee32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75e7643-3b5f-459d-9386-93bdb2d71327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:26 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Volume 02980952-1c34-4df0-908d-d0894a464d4a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02980952-1c34-4df0-908d-d0894a464d4a', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Trying to clone 02980952-1c34-4df0-908d-d0894a464d4a from image 7a555815-8ed6-4460-8cae-4d0c09c11911 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]). {{(pid=83804) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 11:31:26 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" returned: 0 in 0.486s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-0084f1c8-6dde-4ae5-ad65-b2ed420b818f" released by "delete_volume" :: held 1.054s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Created reservations ['cc07bf51-93fd-4ade-9af0-5c16853d08dc', '417fac56-2532-4760-b19f-68af1d1272cb', '0bb6e08b-adc6-4e67-8e54-2446cfa195b1', '2c332f80-8eb9-4605-b55a-db20bcef35fa'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 11:31:27 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Image download 20.69 MB at 20.69 MB/s Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fad39ac-c896-4219-8c93-c2bfba5cf033]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:27 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:27 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:27 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD Apr 16 11:31:27 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:27 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 1G" returned: 0 in 0.522s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:27 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 Apr 16 11:31:27 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (64ca4900-be6b-4af7-ba88-f0ff90c9b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6053bbbf-af1b-40e7-afec-f16271fa380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6053bbbf-af1b-40e7-afec-f16271fa380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-705859958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049b3965-8ecd-42eb-8471-22fa6989c0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a6b60c5b984b5f9aee0ea88cf5189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:27Z,use_quota=True,user_id='6d230de7ab3a43eca27449ca4daa8a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a60dbeb-8199-45af-a109-6b8f89810960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a60dbeb-8199-45af-a109-6b8f89810960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e64694-83ba-439b-a286-83f2130654dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e64694-83ba-439b-a286-83f2130654dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049b3965-8ecd-42eb-8471-22fa6989c0fd', 'volume_name': 'volume-049b3965-8ecd-42eb-8471-22fa6989c0fd', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941c7eab-6b9b-4185-8d76-0eeaf3975877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941c7eab-6b9b-4185-8d76-0eeaf3975877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d511e71d-f11e-4582-a09a-ae59656d896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:27 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Volume 049b3965-8ecd-42eb-8471-22fa6989c0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049b3965-8ecd-42eb-8471-22fa6989c0fd', 'volume_size': 1} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:27 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:27 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 is fetched for user 00de665287a541528c46e76faa76f60f. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.526s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:27 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Deleted volume successfully. Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-edd8e9c0-083b-43ec-b82f-f226062b173d tempest-VolumeDependencyTests-634339314 None] Lock "cinder-0084f1c8-6dde-4ae5-ad65-b2ed420b818f-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cb40a7-e51a-4ab2-86a7-e6dc967f03df]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:27 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD Apr 16 11:31:27 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:27 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57" returned: 0 in 0.498s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:27 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 is being set with open permissions: ugo+rw Apr 16 11:31:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:27 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 Apr 16 11:31:27 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:28 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:28 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57" returned: 0 in 0.414s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:28 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.info Apr 16 11:31:28 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:28 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.info" returned: 0 in 0.425s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:28 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.info is being set with open permissions: ugo+rw Apr 16 11:31:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:28 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.info Apr 16 11:31:28 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:29 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.info" returned: 0 in 0.399s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.817s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-705859958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049b3965-8ecd-42eb-8471-22fa6989c0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a6b60c5b984b5f9aee0ea88cf5189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:27Z,use_quota=True,user_id='6d230de7ab3a43eca27449ca4daa8a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Creating volume 049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:29 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:29 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd 1073741824 Apr 16 11:31:29 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:29 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7ff47e92-b155-42c7-b6fb-753a6f9a7b99 tempest-VolumesDeleteCascade-1060559744 None] Create snapshot completed successfully Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:29 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd 1073741824" returned: 0 in 0.495s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:29 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd Apr 16 11:31:29 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:30 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd" returned: 0 in 0.407s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.885s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754952029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02980952-1c34-4df0-908d-d0894a464d4a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:27Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Creating volume 02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:30 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d511e71d-f11e-4582-a09a-ae59656d896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049b3965-8ecd-42eb-8471-22fa6989c0fd', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448fa5e8-557b-4cf4-bd8a-288b5d997c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:30 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a 1073741824 Apr 16 11:31:30 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:30 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Volume volume-049b3965-8ecd-42eb-8471-22fa6989c0fd (049b3965-8ecd-42eb-8471-22fa6989c0fd): created successfully Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448fa5e8-557b-4cf4-bd8a-288b5d997c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (64ca4900-be6b-4af7-ba88-f0ff90c9b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-cfe51e62-9b01-47bc-ade3-92bbbac4263c tempest-VolumeDependencyTests-634339314 None] Created volume successfully. Apr 16 11:31:30 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a 1073741824" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:30 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a Apr 16 11:31:30 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (053ec5b9-4e89-4dcb-8f9a-3d4174f11c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c8f082-db7c-4b09-8513-d32afb021b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c8f082-db7c-4b09-8513-d32afb021b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-258967287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1eaed9-ba89-4c1f-b438-4273621d1ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a6b60c5b984b5f9aee0ea88cf5189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=049b3965-8ecd-42eb-8471-22fa6989c0fd,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:31Z,use_quota=True,user_id='6d230de7ab3a43eca27449ca4daa8a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f45bb9b-c533-4a80-aa68-f5a9ba071903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f45bb9b-c533-4a80-aa68-f5a9ba071903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9b9138-111e-4946-b528-8f86e411c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9b9138-111e-4946-b528-8f86e411c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6f1eaed9-ba89-4c1f-b438-4273621d1ffc', 'volume_name': 'volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc', 'volume_size': 1, 'source_volid': '049b3965-8ecd-42eb-8471-22fa6989c0fd', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fc2f6a-c25d-4c80-aed5-49bab51ef5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fc2f6a-c25d-4c80-aed5-49bab51ef5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6844675-1604-4d18-9746-2a9ba63f7509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:30 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Volume 6f1eaed9-ba89-4c1f-b438-4273621d1ffc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc', 'volume_size': 1, 'source_volid': '049b3965-8ecd-42eb-8471-22fa6989c0fd', 'source_volstatus': 'available'} Apr 16 11:31:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:31 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a" returned: 0 in 0.433s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.471s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Creating offline snapshot ae38c075-e248-4c8e-9f27-c777d6012d4f of volume 81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Attempting download of 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume 02980952-1c34-4df0-908d-d0894a464d4a. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ade33-ee13-4b72-8b6f-d66b98b26be4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e91bf9-6518-4d55-99c3-3bc91cbef65e]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_tdze2lfc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:31 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 Apr 16 11:31:31 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:31 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_tdze2lfc Apr 16 11:31:31 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:31 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:31 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_tdze2lfc" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:31 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f 1G Apr 16 11:31:31 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_tdze2lfc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:31 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_tdze2lfc Apr 16 11:31:31 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:32 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_tdze2lfc" returned: 1 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a555815-8ed6-4460-8cae-4d0c09c11911_tdze2lfc' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a71be88-cdc6-4269-a192-53253e905c3c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:32 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f 1G" returned: 0 in 0.507s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:32 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f Apr 16 11:31:32 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:32 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD Apr 16 11:31:32 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:32 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f" returned: 0 in 0.419s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:32 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f is being set with open permissions: ugo+rw Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:32 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] 7a555815-8ed6-4460-8cae-4d0c09c11911 was qcow2, converting to raw {{(pid=83804) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 11:31:32 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f Apr 16 11:31:32 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:32 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a Apr 16 11:31:32 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:32 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f" returned: 0 in 0.413s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.905s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:32 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Cloning volume 049b3965-8ecd-42eb-8471-22fa6989c0fd to volume 6f1eaed9-ba89-4c1f-b438-4273621d1ffc Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Creating offline snapshot 799c0147-f217-4f3e-ba10-5e287b5d5657 of volume 049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:31:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-62fbfef4-06f1-4674-ac45-144c43c01bc1 tempest-VolumesDeleteCascade-1060559744 None] Create snapshot completed successfully Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5a1052-1c32-46ce-ab7c-5fb940e17aeb]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:33 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd Apr 16 11:31:33 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:33 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a" returned: 0 in 0.848s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a555815-8ed6-4460-8cae-4d0c09c11911_ezzjd4mudevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:31:33 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:33 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a 1G Apr 16 11:31:33 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:33 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd" returned: 0 in 0.518s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:33 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 1G Apr 16 11:31:33 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Performing cascade delete. {{(pid=83804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-ae38c075-e248-4c8e-9f27-c777d6012d4f-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-ae38c075-e248-4c8e-9f27-c777d6012d4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-ae38c075-e248-4c8e-9f27-c777d6012d4f" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-ae38c075-e248-4c8e-9f27-c777d6012d4f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Deleting offline snapshot ae38c075-e248-4c8e-9f27-c777d6012d4f of volume 81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] snapshot_file for this snap is: volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f399b0-a328-4c8d-be1b-47929c9df458]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:33 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a 1G" returned: 0 in 0.488s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f4d85a-7cfa-4344-b2a3-f7f7152e8c46]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:33 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f Apr 16 11:31:33 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:33 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a Apr 16 11:31:33 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:33 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 1G" returned: 0 in 0.497s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049b3965-8ecd-42eb-8471-22fa6989c0fd -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:34 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049b3965-8ecd-42eb-8471-22fa6989c0fd -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 Apr 16 11:31:34 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:34 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:34 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f" returned: 0 in 0.532s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc54c41-9d59-443e-acc0-70206198d33d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:34 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a Apr 16 11:31:34 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:34 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 Apr 16 11:31:34 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:34 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-049b3965-8ecd-42eb-8471-22fa6989c0fd -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:34 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 is being set with open permissions: ugo+rw Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:34 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 Apr 16 11:31:34 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:34 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a" returned: 1 in 0.481s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Downloaded image 7a555815-8ed6-4460-8cae-4d0c09c11911 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}])) to volume 02980952-1c34-4df0-908d-d0894a464d4a successfully. {{(pid=83804) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 11:31:34 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Temporary image 7a555815-8ed6-4460-8cae-4d0c09c11911 for user 00de665287a541528c46e76faa76f60f is deleted. {{(pid=83804) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.volume_utils [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Marking volume 02980952-1c34-4df0-908d-d0894a464d4a as bootable. {{(pid=83804) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57" returned: 0 in 0.469s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Copying metadata from image 7a555815-8ed6-4460-8cae-4d0c09c11911 to 02980952-1c34-4df0-908d-d0894a464d4a. {{(pid=83804) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Creating volume glance metadata for volume 02980952-1c34-4df0-908d-d0894a464d4a backed by image 7a555815-8ed6-4460-8cae-4d0c09c11911 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83804) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 11:31:34 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f Apr 16 11:31:34 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:34 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657" returned: 0 in 0.456s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75e7643-3b5f-459d-9386-93bdb2d71327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02980952-1c34-4df0-908d-d0894a464d4a', 'volume_size': 1, 'image_id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a555815-8ed6-4460-8cae-4d0c09c11911', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf8049a8f7d4264b6c550fc0672a417', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7a555815-8ed6-4460-8cae-4d0c09c11911', 'created_at': datetime.datetime(2026, 4, 16, 9, 20, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 9, 20, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a555815-8ed6-4460-8cae-4d0c09c11911/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95f6b3a-601c-4d39-8541-838734fbe461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:34 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Volume volume-02980952-1c34-4df0-908d-d0894a464d4a (02980952-1c34-4df0-908d-d0894a464d4a): created successfully Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95f6b3a-601c-4d39-8541-838734fbe461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (b074bf08-b9ba-4286-8820-9567af372689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:34 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4d96f4a8-5edd-419c-9a99-ea3474aa2a02 tempest-VolumesGetTest-850842585 None] Created volume successfully. Apr 16 11:31:34 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.info Apr 16 11:31:34 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:35 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f" returned: 0 in 0.503s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:35 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f Apr 16 11:31:35 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:35 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.info" returned: 0 in 0.454s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:35 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.info is being set with open permissions: ugo+rw Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:35 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.info Apr 16 11:31:35 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (5a5fc3eb-8ca8-41e3-af8d-3f88a8ca6785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc0559b-3805-40f1-9ee7-ad55f0608d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc0559b-3805-40f1-9ee7-ad55f0608d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-895615938',display_name='tempest-VolumesGetTest-Volume-1408249104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94350375-ea34-4c06-a8f6-5fb5abd46864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:36Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d171ddaf-87fb-45ea-b765-26d01bc92c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d171ddaf-87fb-45ea-b765-26d01bc92c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a58848-012c-4c47-a26d-42740b28dc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a58848-012c-4c47-a26d-42740b28dc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94350375-ea34-4c06-a8f6-5fb5abd46864', 'volume_name': 'volume-94350375-ea34-4c06-a8f6-5fb5abd46864', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144bbfe4-50b4-4141-a042-f4f2599ae2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144bbfe4-50b4-4141-a042-f4f2599ae2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9a5a1-1cf7-4a9a-82f3-e921f9361ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:35 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Volume 94350375-ea34-4c06-a8f6-5fb5abd46864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94350375-ea34-4c06-a8f6-5fb5abd46864', 'volume_size': 1} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:35 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.ae38c075-e248-4c8e-9f27-c777d6012d4f" returned: 0 in 0.434s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-ae38c075-e248-4c8e-9f27-c777d6012d4f" released by "_delete_snapshot" :: held 1.983s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" released by "delete_snapshot" :: held 2.003s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Created reservations ['a8aad6c3-7667-40b7-b1c9-35fdaf6ebe80', 'a045ec61-1255-47b8-942a-0c027318047d', '22923422-c1d3-449a-8d36-73e3f4e55521', '9c306db3-43eb-4c1f-8e3e-2c78953e8d9e'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:35 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.info" returned: 0 in 0.441s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Delete snapshot completed successfully. Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] snapshot: 799c0147-f217-4f3e-ba10-5e287b5d5657, volume: 6f1eaed9-ba89-4c1f-b438-4273621d1ffc, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-ae38c075-e248-4c8e-9f27-c777d6012d4f-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-e5a4a4e1-625a-4193-9da3-83ee7533ce57-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[05953c2e-1080-48f1-b32c-ef268b267c27]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-e5a4a4e1-625a-4193-9da3-83ee7533ce57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-e5a4a4e1-625a-4193-9da3-83ee7533ce57" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-e5a4a4e1-625a-4193-9da3-83ee7533ce57" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Deleting offline snapshot e5a4a4e1-625a-4193-9da3-83ee7533ce57 of volume 81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] snapshot_file for this snap is: volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8a9b04-6876-4654-937f-5f3b54d85262]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:35 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 Apr 16 11:31:35 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:35 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 Apr 16 11:31:36 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:36 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657" returned: 0 in 0.482s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-049b3965-8ecd-42eb-8471-22fa6989c0fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8724229-c64b-4bd7-9515-3c89909abdc2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:36 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[577b9bf0-39f0-4210-b052-f1338c838168]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:36 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd Apr 16 11:31:36 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:36 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e Apr 16 11:31:36 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:36 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd" returned: 0 in 0.472s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:36 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc Apr 16 11:31:36 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:36 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:36 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 Apr 16 11:31:36 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:37 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57" returned: 0 in 0.836s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:37 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57 Apr 16 11:31:37 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:38 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e.e5a4a4e1-625a-4193-9da3-83ee7533ce57" returned: 0 in 1.053s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-e5a4a4e1-625a-4193-9da3-83ee7533ce57" released by "_delete_snapshot" :: held 2.918s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" released by "delete_snapshot" :: held 2.929s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:38 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" returned: 0 in 2.057s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d04e1-f48c-44d4-91f3-a05c0be15c48]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Created reservations ['1ccb4414-ea23-4f2e-a2ea-75b0d85f4fcc', '15347912-fd29-4d20-897f-a17438d79ade', '950ba01d-9994-45e2-9c67-27efee43d665', 'cda6472d-6f35-4dca-88f4-acae01440d59'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:38 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Delete snapshot completed successfully. Apr 16 11:31:38 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd Apr 16 11:31:38 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-e5a4a4e1-625a-4193-9da3-83ee7533ce57-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Snapshots deleted, issuing volume delete {{(pid=83804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5528f952-f95e-4618-a153-b9e88839cab9]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:39 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e Apr 16 11:31:39 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:39 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:39 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd" returned: 0 in 0.588s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:31:39 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Converted 1024.00 MB image at 497.55 MB/s Apr 16 11:31:39 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc is being set with open permissions: ugo+rw Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:39 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e Apr 16 11:31:39 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:39 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc Apr 16 11:31:39 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:39 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" returned: 0 in 0.401s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:39 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" released by "_copy_volume_from_snapshot" :: held 4.052s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" returned: 0 in 0.428s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e" released by "delete_volume" :: held 0.933s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-799c0147-f217-4f3e-ba10-5e287b5d5657" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-799c0147-f217-4f3e-ba10-5e287b5d5657" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Deleting offline snapshot 799c0147-f217-4f3e-ba10-5e287b5d5657 of volume 049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] snapshot_file for this snap is: volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Created reservations ['c408cb2c-b084-4ae7-b9e9-17df4083f2b9', 'fbedc073-764a-4f1d-8b6c-05b10086192b', '05ec5abc-3c59-4395-8b0c-e01a8712f926', '09836f30-8ed5-46d7-afc1-51ca39a1f1fc'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb871ddc-7793-43d9-b1e4-420818dbc230]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:40 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 Apr 16 11:31:40 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:40 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:40 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Flow 'volume_create_manager' (fb04cc28-bb86-42e6-bd96-41fca54b9b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d065c3a-6537-45a7-9aa2-e9cd7763631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d065c3a-6537-45a7-9aa2-e9cd7763631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-598562268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fa6ec9-52c0-453f-a37b-35fc2775c672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c031e30a7734cd3b5c82859ff757b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:40Z,use_quota=True,user_id='860f28b24c264662a2fba44124ade26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861ac273-1d80-44cd-9d55-1e41cede0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861ac273-1d80-44cd-9d55-1e41cede0341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed9e843-904d-40e5-8168-5dd80139dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed9e843-904d-40e5-8168-5dd80139dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37fa6ec9-52c0-453f-a37b-35fc2775c672', 'volume_name': 'volume-37fa6ec9-52c0-453f-a37b-35fc2775c672', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7efbbc-764d-431b-a8a6-62ce87c8ccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7efbbc-764d-431b-a8a6-62ce87c8ccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:40 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b86477-9909-4715-b9e8-9e224832aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:40 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Volume 37fa6ec9-52c0-453f-a37b-35fc2775c672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37fa6ec9-52c0-453f-a37b-35fc2775c672', 'volume_size': 1} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657" returned: 0 in 0.527s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-049b3965-8ecd-42eb-8471-22fa6989c0fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:40 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0707d9a7-970f-4363-8716-99da4efdc10e]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:40 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Deleted volume successfully. Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-beffe885-2510-459b-82a9-692698e452d6 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-81fc1a64-9a22-4c8e-86b3-a7eb0147f91e-delete_volume" released by "delete_volume" :: held 6.830s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:40 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd Apr 16 11:31:40 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:40 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:41 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 Apr 16 11:31:41 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:41 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:41 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657 Apr 16 11:31:41 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:41 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd.799c0147-f217-4f3e-ba10-5e287b5d5657" returned: 0 in 0.408s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-799c0147-f217-4f3e-ba10-5e287b5d5657" released by "_delete_snapshot" :: held 1.921s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.012s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.274s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-895615938',display_name='tempest-VolumesGetTest-Volume-1408249104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94350375-ea34-4c06-a8f6-5fb5abd46864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63178df1bcba43d1bf4dc8337bf9f7b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:36Z,use_quota=True,user_id='00de665287a541528c46e76faa76f60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Creating volume 94350375-ea34-4c06-a8f6-5fb5abd46864 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:41 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6844675-1604-4d18-9746-2a9ba63f7509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc', 'volume_size': 1, 'source_volid': '049b3965-8ecd-42eb-8471-22fa6989c0fd', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c866da-bd7f-4781-95ce-4c7856f0fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:41 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 1073741824 Apr 16 11:31:41 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:41 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Volume volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc (6f1eaed9-ba89-4c1f-b438-4273621d1ffc): created successfully Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c866da-bd7f-4781-95ce-4c7856f0fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Flow 'volume_create_manager' (053ec5b9-4e89-4dcb-8f9a-3d4174f11c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:41 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-3a706cb8-22fb-4084-b4e5-1283a6d852f6 tempest-VolumeDependencyTests-634339314 None] Created volume successfully. Apr 16 11:31:42 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 1073741824" returned: 0 in 0.480s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:42 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 Apr 16 11:31:42 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-049b3965-8ecd-42eb-8471-22fa6989c0fd-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Lock "cinder-049b3965-8ecd-42eb-8471-22fa6989c0fd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-049b3965-8ecd-42eb-8471-22fa6989c0fd" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-049b3965-8ecd-42eb-8471-22fa6989c0fd" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2339df-f87b-4960-b273-d38edcfc8bfe]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:42 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd Apr 16 11:31:42 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:42 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-598562268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fa6ec9-52c0-453f-a37b-35fc2775c672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c031e30a7734cd3b5c82859ff757b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:40Z,use_quota=True,user_id='860f28b24c264662a2fba44124ade26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Creating volume 37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:42 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9a5a1-1cf7-4a9a-82f3-e921f9361ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94350375-ea34-4c06-a8f6-5fb5abd46864', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca961537-21ea-4019-9d36-93d08d6260fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:42 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 1073741824 Apr 16 11:31:42 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:42 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Volume volume-94350375-ea34-4c06-a8f6-5fb5abd46864 (94350375-ea34-4c06-a8f6-5fb5abd46864): created successfully Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca961537-21ea-4019-9d36-93d08d6260fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Flow 'volume_create_manager' (5a5fc3eb-8ca8-41e3-af8d-3f88a8ca6785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:42 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-658dd496-0a41-4dcc-b564-ccca4d5fb3ad tempest-VolumesGetTest-850842585 None] Created volume successfully. Apr 16 11:31:42 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:43 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd Apr 16 11:31:43 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-94350375-ea34-4c06-a8f6-5fb5abd46864-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Lock "cinder-94350375-ea34-4c06-a8f6-5fb5abd46864-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-94350375-ea34-4c06-a8f6-5fb5abd46864" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-94350375-ea34-4c06-a8f6-5fb5abd46864" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[905305fc-a9f3-456d-bf05-d8df07ed3eaa]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:43 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 Apr 16 11:31:43 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:43 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-049b3965-8ecd-42eb-8471-22fa6989c0fd" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:43 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 1073741824" returned: 0 in 0.550s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-049b3965-8ecd-42eb-8471-22fa6989c0fd" released by "delete_volume" :: held 0.931s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:43 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 Apr 16 11:31:43 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Created reservations ['11694011-4673-4c32-a049-459ce65eb390', 'ee506acb-64b6-4154-89f2-0c3974fcf6c2', '28998cf7-686b-40a4-a018-44a3ce6d70e3', 'fe409941-85ea-48c0-ade1-965eecd648aa'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:43 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:43 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-6f1eaed9-ba89-4c1f-b438-4273621d1ffc-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Lock "cinder-6f1eaed9-ba89-4c1f-b438-4273621d1ffc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96cd72b-94de-46e4-8e88-0a2dcf7373a7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:43 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc Apr 16 11:31:43 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:43 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864" returned: 0 in 0.552s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:43 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864 Apr 16 11:31:43 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:43 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672" returned: 0 in 0.455s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b86477-9909-4715-b9e8-9e224832aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37fa6ec9-52c0-453f-a37b-35fc2775c672', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865358f6-cc38-47a6-b7e7-81422b7150e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:43 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Volume volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 (37fa6ec9-52c0-453f-a37b-35fc2775c672): created successfully Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865358f6-cc38-47a6-b7e7-81422b7150e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Flow 'volume_create_manager' (fb04cc28-bb86-42e6-bd96-41fca54b9b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-70143799-70a4-4f48-a108-9c5b2f034b47 tempest-VolumesDeleteCascade-1060559744 None] Created volume successfully. Apr 16 11:31:44 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Deleted volume successfully. Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-47c6a1c6-c0c8-4ef6-8cf2-b5aacfe2530a tempest-VolumeDependencyTests-634339314 None] Lock "cinder-049b3965-8ecd-42eb-8471-22fa6989c0fd-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:44 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:44 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc Apr 16 11:31:44 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:44 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-94350375-ea34-4c06-a8f6-5fb5abd46864" returned: 0 in 0.427s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-94350375-ea34-4c06-a8f6-5fb5abd46864" released by "delete_volume" :: held 1.008s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Created reservations ['0c64f471-9ae7-458b-903b-495921fea0de', '5637a6e0-6738-428c-b350-f24d9fffff69', '1cd5d938-45f3-4b53-a6a2-cd7069176f85', 'a55874ec-a7c5-4e34-85dd-484adc200066'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:44 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:44 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:44 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" returned: 0 in 0.406s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-6f1eaed9-ba89-4c1f-b438-4273621d1ffc" released by "delete_volume" :: held 0.916s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Created reservations ['14d7255a-4f92-463f-8ab0-6731e8773d5f', 'e9abc142-4e5e-45de-9a93-3abb5a1bbbbb', '0a0f3fa2-7238-4885-ba74-10b4c248128a', '51686128-29e1-4011-80a3-08bf39f9d239'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:44 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:44 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:44 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.455s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Deleted volume successfully. Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-35639b1b-1168-402a-b410-c319eccf8002-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-35639b1b-1168-402a-b410-c319eccf8002-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f43bb27-1298-44b6-8a3e-496f5510c4ed tempest-VolumesGetTest-850842585 None] Lock "cinder-94350375-ea34-4c06-a8f6-5fb5abd46864-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "cinder-quobyte-35639b1b-1168-402a-b410-c319eccf8002" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-35639b1b-1168-402a-b410-c319eccf8002" acquired by "delete_volume" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bcaa9-d3b5-46bf-9552-fc6f16c7439a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Creating offline snapshot d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c of volume 37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e55b9ab-074f-4484-94f5-ba1815da6300]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:44 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 Apr 16 11:31:44 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:44 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 Apr 16 11:31:44 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:45 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.472s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:45 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Deleted volume successfully. Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-09e2e4e8-122c-4596-82ed-6fc0722f31fd tempest-VolumeDependencyTests-634339314 None] Lock "cinder-6f1eaed9-ba89-4c1f-b438-4273621d1ffc-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:45 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002" returned: 0 in 0.504s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:45 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672" returned: 0 in 0.486s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:45 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002 Apr 16 11:31:45 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-02980952-1c34-4df0-908d-d0894a464d4a-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:45 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c 1G Apr 16 11:31:45 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Lock "cinder-02980952-1c34-4df0-908d-d0894a464d4a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Acquiring lock "cinder-quobyte-02980952-1c34-4df0-908d-d0894a464d4a" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-02980952-1c34-4df0-908d-d0894a464d4a" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b700182-3705-4448-9fb4-0a42e2e5a460]: (4, 'raw') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:45 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a Apr 16 11:31:45 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:45 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-35639b1b-1168-402a-b410-c319eccf8002" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-quobyte-35639b1b-1168-402a-b410-c319eccf8002" released by "delete_volume" :: held 0.972s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Created reservations ['d186a1ef-124c-4a2e-b3ff-984e6e498b2b', '33a7271b-75ce-4acc-a783-b0450c32c74c', '1f05a7bb-6d08-4f43-a0b0-22740efb6915', '89963997-5642-4eb2-8b5a-acbcb277d26d'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:45 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:45 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:45 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c 1G" returned: 0 in 0.556s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:45 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c Apr 16 11:31:45 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:46 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a" returned: 0 in 0.535s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:46 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a Apr 16 11:31:46 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:46 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.422s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Deleted volume successfully. Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c1418d4d-e8a3-4bd1-aeb2-149d82950437 tempest-VolumeDependencyTests-634339314 None] Lock "cinder-35639b1b-1168-402a-b410-c319eccf8002-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:46 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" returned: 0 in 0.442s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:46 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c is being set with open permissions: ugo+rw Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:46 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c Apr 16 11:31:46 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:46 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a" returned: 1 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a' failed. Not Retrying. {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:46 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a Apr 16 11:31:46 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:46 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" returned: 0 in 0.419s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:46 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.info Apr 16 11:31:46 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:46 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-02980952-1c34-4df0-908d-d0894a464d4a" returned: 0 in 0.421s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Lock "cinder-quobyte-02980952-1c34-4df0-908d-d0894a464d4a" released by "delete_volume" :: held 1.475s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:46 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Created reservations ['69a50837-bab5-4cb9-8939-7e02614ebebc', '3b3c756b-eea4-4ec1-8e60-dec00cd43272', 'c5487e20-3467-4784-ad65-84fb7f9b49ff', '260a7daf-6841-4414-b350-62b3967f7b7a'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:47 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:47 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:47 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.info" returned: 0 in 0.444s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:47 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.info is being set with open permissions: ugo+rw Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:47 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.info Apr 16 11:31:47 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:47 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Deleted volume successfully. Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6f81aae0-a564-4e1f-b176-4b2bd40a6f0d tempest-VolumesGetTest-850842585 None] Lock "cinder-02980952-1c34-4df0-908d-d0894a464d4a-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:47 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.info" returned: 0 in 0.521s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.934s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ed07f2c7-8e69-4a48-b049-6d9264bbf788 tempest-VolumesDeleteCascade-1060559744 None] Create snapshot completed successfully Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Flow 'volume_create_manager' (0707cb8e-a2a8-42c9-b03d-acd536a5e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555b6926-5e9f-408f-bdd1-25a601a0b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555b6926-5e9f-408f-bdd1-25a601a0b80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1811520709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84a5937-11f3-4480-8b88-a523849dceef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c031e30a7734cd3b5c82859ff757b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:31:48Z,use_quota=True,user_id='860f28b24c264662a2fba44124ade26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fb0a73-9193-491c-b66c-bbb56799b40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fb0a73-9193-491c-b66c-bbb56799b40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1f3e4a-854d-4a61-bd5b-acc73ffc4a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1f3e4a-854d-4a61-bd5b-acc73ffc4a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f84a5937-11f3-4480-8b88-a523849dceef', 'volume_name': 'volume-f84a5937-11f3-4480-8b88-a523849dceef', 'volume_size': 1, 'snapshot_id': 'd27810ef-2ed0-4c53-b7f1-96af9f8b2d5c'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02249779-3e67-4d46-a8e7-f3cc6d67dd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02249779-3e67-4d46-a8e7-f3cc6d67dd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a194373-f90e-4d70-b721-5d7364e9bcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:48 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Volume f84a5937-11f3-4480-8b88-a523849dceef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f84a5937-11f3-4480-8b88-a523849dceef', 'volume_size': 1, 'snapshot_id': 'd27810ef-2ed0-4c53-b7f1-96af9f8b2d5c'} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c-f84a5937-11f3-4480-8b88-a523849dceef" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c-f84a5937-11f3-4480-8b88-a523849dceef" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Creating volume f84a5937-11f3-4480-8b88-a523849dceef from snapshot d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-f84a5937-11f3-4480-8b88-a523849dceef" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-f84a5937-11f3-4480-8b88-a523849dceef" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] snapshot: d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c, volume: f84a5937-11f3-4480-8b88-a523849dceef, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd68d484-5f74-4fcf-9d28-7081880cb641]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:48 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c Apr 16 11:31:48 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:48 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" returned: 0 in 0.571s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37fa6ec9-52c0-453f-a37b-35fc2775c672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:31:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:31:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e39009-48e1-4169-930e-9f866cd36d47]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:49 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 Apr 16 11:31:49 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:49 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672" returned: 0 in 0.521s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:49 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:31:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:49 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef Apr 16 11:31:49 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:51 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef" returned: 0 in 2.246s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:51 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3276e987-1e2c-4d19-8b36-bceae09880ec]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:51 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 Apr 16 11:31:51 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:52 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672" returned: 0 in 0.670s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:31:52 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Converted 1024.00 MB image at 455.69 MB/s Apr 16 11:31:52 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef is being set with open permissions: ugo+rw Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:52 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef Apr 16 11:31:52 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:52 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef" returned: 0 in 0.488s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-f84a5937-11f3-4480-8b88-a523849dceef" released by "_copy_volume_from_snapshot" :: held 4.556s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c-f84a5937-11f3-4480-8b88-a523849dceef" released by "_create_volume_from_snapshot" :: held 4.577s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.589s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a194373-f90e-4d70-b721-5d7364e9bcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84a5937-11f3-4480-8b88-a523849dceef', 'volume_size': 1, 'snapshot_id': 'd27810ef-2ed0-4c53-b7f1-96af9f8b2d5c'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356e0201-9f7d-4c1f-9232-e06979e471e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:31:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Volume volume-f84a5937-11f3-4480-8b88-a523849dceef (f84a5937-11f3-4480-8b88-a523849dceef): created successfully Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356e0201-9f7d-4c1f-9232-e06979e471e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:31:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Flow 'volume_create_manager' (0707cb8e-a2a8-42c9-b03d-acd536a5e934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:31:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-86be6a47-02ef-413b-87d9-452a175be005 tempest-VolumesDeleteCascade-1060559744 None] Created volume successfully. Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-37fa6ec9-52c0-453f-a37b-35fc2775c672-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-37fa6ec9-52c0-453f-a37b-35fc2775c672-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Performing cascade delete. {{(pid=83804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-37fa6ec9-52c0-453f-a37b-35fc2775c672" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-37fa6ec9-52c0-453f-a37b-35fc2775c672" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Deleting offline snapshot d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c of volume 37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] snapshot_file for this snap is: volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2166c87f-e11b-47af-aa99-52c399785d22]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:53 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c Apr 16 11:31:53 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:54 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" returned: 0 in 0.516s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37fa6ec9-52c0-453f-a37b-35fc2775c672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:31:54 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bc336a-ad6a-4fa5-9c36-4be10c701050]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:54 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 Apr 16 11:31:54 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:54 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672" returned: 0 in 0.575s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:54 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c Apr 16 11:31:54 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:55 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" returned: 0 in 0.495s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:55 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c Apr 16 11:31:55 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:55 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672.d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c" released by "_delete_snapshot" :: held 2.133s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-37fa6ec9-52c0-453f-a37b-35fc2775c672" released by "delete_snapshot" :: held 2.146s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Created reservations ['fa293e63-64b7-4134-a36d-99f763d970eb', '4b4e68ba-ae01-4c3e-b1a5-332d0f63a584', '2a6141f1-e0db-4f6c-9fbf-1058a53808cf', 'ebc8e1d8-0c4a-4452-a6fe-1245199aaac5'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Delete snapshot completed successfully. Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-d27810ef-2ed0-4c53-b7f1-96af9f8b2d5c-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Snapshots deleted, issuing volume delete {{(pid=83804) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-37fa6ec9-52c0-453f-a37b-35fc2775c672" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-37fa6ec9-52c0-453f-a37b-35fc2775c672" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a2313f-68e5-41ca-a940-6392ef0a2353]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:56 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 Apr 16 11:31:56 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:56 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672" returned: 0 in 0.557s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:56 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672 Apr 16 11:31:56 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:57 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-37fa6ec9-52c0-453f-a37b-35fc2775c672" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-37fa6ec9-52c0-453f-a37b-35fc2775c672" released by "delete_volume" :: held 1.034s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Created reservations ['55cb3a0d-ba01-4f95-9ecb-f2fb35f1ef67', '5cb866c4-0453-4ce9-971b-9c445979ac13', 'a5fa8ca2-d7b0-4268-acf8-4d720a7918ba', '0f8a5a24-b293-4e88-8c11-e069ee29cd12'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:57 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:57 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:57 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Deleted volume successfully. Apr 16 11:31:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-6ee9736a-ed05-4018-9bbf-4751afcf5fad tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-37fa6ec9-52c0-453f-a37b-35fc2775c672-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-f84a5937-11f3-4480-8b88-a523849dceef-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-f84a5937-11f3-4480-8b88-a523849dceef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "cinder-quobyte-f84a5937-11f3-4480-8b88-a523849dceef" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-f84a5937-11f3-4480-8b88-a523849dceef" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c87993b-2636-4e9a-806f-0fdbd0b4ae9b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:58 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef Apr 16 11:31:58 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:58 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef" returned: 0 in 0.482s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:58 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef Apr 16 11:31:58 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:59 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f84a5937-11f3-4480-8b88-a523849dceef" returned: 0 in 0.428s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-quobyte-f84a5937-11f3-4480-8b88-a523849dceef" released by "delete_volume" :: held 0.946s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Created reservations ['2a6ba458-04d7-49c8-981f-c8475d976e45', 'f0d68084-3472-4104-bcc3-4276d426d934', '1e5db9ae-f3d5-43c3-9b42-88da37515c25', '7fadba16-2c32-46f2-b3eb-5fe74c5cebce'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:31:59 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:31:59 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:31:59 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:31:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Deleted volume successfully. Apr 16 11:31:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e60e4805-af05-46ca-9aed-83b87a093d5d tempest-VolumesDeleteCascade-1060559744 None] Lock "cinder-f84a5937-11f3-4480-8b88-a523849dceef-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Flow 'volume_create_manager' (b432f677-fb4c-4f50-a2fc-7360cf537da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f28e928-2fdf-4c25-901d-361eaa9f3541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f28e928-2fdf-4c25-901d-361eaa9f3541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-819415503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1fb1d5-1f22-4249-b781-596cfbad3b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56231c9fcca40298ab3e25ab4dedfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:03Z,use_quota=True,user_id='091ba94f68fd4e1192c29b8e79f91176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea66302-7620-42c2-85cf-12ea985c6552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea66302-7620-42c2-85cf-12ea985c6552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febfd070-a971-4d21-a850-15aa0fe41ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (febfd070-a971-4d21-a850-15aa0fe41ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1fb1d5-1f22-4249-b781-596cfbad3b37', 'volume_name': 'volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08fa6a8-b411-47f6-9b90-2309874ccda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08fa6a8-b411-47f6-9b90-2309874ccda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c957d8-182f-4bb3-8875-0977d83a4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:02 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Volume 3b1fb1d5-1f22-4249-b781-596cfbad3b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37', 'volume_size': 1} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-819415503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1fb1d5-1f22-4249-b781-596cfbad3b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56231c9fcca40298ab3e25ab4dedfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:03Z,use_quota=True,user_id='091ba94f68fd4e1192c29b8e79f91176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Creating volume 3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:02 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:02 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 1073741824 Apr 16 11:32:02 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Flow 'volume_create_manager' (3f8492f4-2faa-4179-a7d8-06361cd83ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5df090a-ccbb-4021-9b5d-b318f5f30683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5df090a-ccbb-4021-9b5d-b318f5f30683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1286578582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec42fcf6-fb32-4e61-a6a6-950fea6ec83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfff8aac628c4aaca5c3c06d7447ff6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:03Z,use_quota=True,user_id='541fd16045a44003829abedceca0ed8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0bccf0-11dd-44d0-8e88-07ebed9aad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0bccf0-11dd-44d0-8e88-07ebed9aad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a8965-ba1c-49ea-9e11-0b992cecc5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a8965-ba1c-49ea-9e11-0b992cecc5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec42fcf6-fb32-4e61-a6a6-950fea6ec83b', 'volume_name': 'volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dcecaa-03a4-4991-9d0b-decdc4c92f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37dcecaa-03a4-4991-9d0b-decdc4c92f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d636f45f-94e5-4187-bfb9-49ea4ed07668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:03 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Volume ec42fcf6-fb32-4e61-a6a6-950fea6ec83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b', 'volume_size': 1} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:03 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 1073741824" returned: 0 in 0.618s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:03 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 Apr 16 11:32:03 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:03 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37" returned: 0 in 0.438s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1286578582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec42fcf6-fb32-4e61-a6a6-950fea6ec83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfff8aac628c4aaca5c3c06d7447ff6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:03Z,use_quota=True,user_id='541fd16045a44003829abedceca0ed8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Creating volume ec42fcf6-fb32-4e61-a6a6-950fea6ec83b {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:03 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c957d8-182f-4bb3-8875-0977d83a4484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:03 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b 1073741824 Apr 16 11:32:03 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b62273-f1d3-4e31-9ba9-71d01d3dd863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:03 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Volume volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 (3b1fb1d5-1f22-4249-b781-596cfbad3b37): created successfully Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b62273-f1d3-4e31-9ba9-71d01d3dd863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Flow 'volume_create_manager' (b432f677-fb4c-4f50-a2fc-7360cf537da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-461ba55a-9c7c-4a3f-869a-407c5de78629 tempest-SnapshotDependencyTests-1263282125 None] Created volume successfully. Apr 16 11:32:04 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b 1073741824" returned: 0 in 0.494s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:04 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b Apr 16 11:32:04 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:04 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b" returned: 0 in 0.425s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d636f45f-94e5-4187-bfb9-49ea4ed07668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c2290d-1994-45cb-9f31-550b174c7335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:05 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Volume volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b (ec42fcf6-fb32-4e61-a6a6-950fea6ec83b): created successfully Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c2290d-1994-45cb-9f31-550b174c7335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Flow 'volume_create_manager' (3f8492f4-2faa-4179-a7d8-06361cd83ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:05 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b7baa3c7-040a-4483-acdb-cf6ba488a310 tempest-VolumesTransfersV355Test-421913597 None] Created volume successfully. Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Creating offline snapshot b4b76a19-26bd-4fc4-a023-ab9b7779da03 of volume 3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6f3eb5-e011-4dad-b7d5-7d5ef2a4e332]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:05 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 Apr 16 11:32:05 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:05 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:05 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 1G Apr 16 11:32:05 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:06 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 1G" returned: 0 in 0.512s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:06 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 Apr 16 11:32:06 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:06 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:06 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 is being set with open permissions: ugo+rw Apr 16 11:32:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:06 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 Apr 16 11:32:06 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:07 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a4499648-f1b5-4b94-966c-15ce0fed465b tempest-VolumesTransfersV355Test-747014933 None] Transfer volume completed successfully. Apr 16 11:32:07 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03" returned: 0 in 0.416s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=147,cinder:UPDATE=168,cinder:INSERT=48,cinder:DELETE=17 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:32:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=182,cinder:SELECT=132,cinder:INSERT=50,cinder:DELETE=14 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:32:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:07 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.info Apr 16 11:32:07 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:07 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.info" returned: 0 in 0.417s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:07 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.info is being set with open permissions: ugo+rw Apr 16 11:32:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:07 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.info Apr 16 11:32:07 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:08 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.info" returned: 0 in 0.480s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2dcdbfe5-5b65-4bfb-b070-7a777757d1c0 tempest-SnapshotDependencyTests-1263282125 None] Create snapshot completed successfully Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Acquiring lock "cinder-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Acquiring lock "cinder-quobyte-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-quobyte-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cbd438-293b-4ff0-af0f-ff8c037b3403]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:08 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b Apr 16 11:32:08 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:09 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b" returned: 0 in 0.479s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:09 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b Apr 16 11:32:09 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Flow 'volume_create_manager' (287ffd43-0bb2-41d4-8f55-595915b5d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d56f1f9-01eb-4fc9-a51d-063eb38a42e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d56f1f9-01eb-4fc9-a51d-063eb38a42e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9992343-e418-43e1-9bba-07733d329d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56231c9fcca40298ab3e25ab4dedfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4b76a19-26bd-4fc4-a023-ab9b7779da03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:09Z,use_quota=True,user_id='091ba94f68fd4e1192c29b8e79f91176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed192fe4-300c-4bb2-8cdb-6c0a016dc5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed192fe4-300c-4bb2-8cdb-6c0a016dc5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d95fa1b-1260-4510-982b-1c0f3f8a06f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d95fa1b-1260-4510-982b-1c0f3f8a06f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9992343-e418-43e1-9bba-07733d329d56', 'volume_name': 'volume-f9992343-e418-43e1-9bba-07733d329d56', 'volume_size': 1, 'snapshot_id': 'b4b76a19-26bd-4fc4-a023-ab9b7779da03'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f077b1-ea69-43f5-9929-e5ee3dc18ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f077b1-ea69-43f5-9929-e5ee3dc18ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adb4946-5434-431d-93d7-8f3a238b5bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:09 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Volume f9992343-e418-43e1-9bba-07733d329d56: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9992343-e418-43e1-9bba-07733d329d56', 'volume_size': 1, 'snapshot_id': 'b4b76a19-26bd-4fc4-a023-ab9b7779da03'} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-quobyte-b4b76a19-26bd-4fc4-a023-ab9b7779da03-f9992343-e418-43e1-9bba-07733d329d56" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-b4b76a19-26bd-4fc4-a023-ab9b7779da03-f9992343-e418-43e1-9bba-07733d329d56" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Creating volume f9992343-e418-43e1-9bba-07733d329d56 from snapshot b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-quobyte-f9992343-e418-43e1-9bba-07733d329d56" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-f9992343-e418-43e1-9bba-07733d329d56" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] snapshot: b4b76a19-26bd-4fc4-a023-ab9b7779da03, volume: f9992343-e418-43e1-9bba-07733d329d56, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be35d8-9e7c-4117-9f6c-33aea40da158]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:09 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b" returned: 0 in 0.449s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-quobyte-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b" released by "delete_volume" :: held 0.952s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:09 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 Apr 16 11:32:09 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Created reservations ['58d23a5a-3306-4773-8e79-1c153047f6fc', '162f1929-d671-4cac-9cf4-e82bb04f8691', 'b4f5ffb8-4997-41fe-a758-de5177fb1166', '65732828-626c-40f8-b15e-f6017f9f5bb0'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:09 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:09 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:09 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a165f67-fddb-410d-b8e3-daa50e131371]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:10 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 Apr 16 11:32:10 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:10 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.411s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:10 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Deleted volume successfully. Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-519e0b67-9502-4a6a-99fc-37bd34c93880 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-ec42fcf6-fb32-4e61-a6a6-950fea6ec83b-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:10 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:10 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 Apr 16 11:32:10 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:10 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:10 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Flow 'volume_create_manager' (e675a4af-5fd2-4c92-8f87-5cf886618865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95a219d-e8b3-4e8f-9d92-743bac4c32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95a219d-e8b3-4e8f-9d92-743bac4c32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1539063344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a1e011-0753-44eb-85a3-9e51ec7899c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfff8aac628c4aaca5c3c06d7447ff6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:11Z,use_quota=True,user_id='541fd16045a44003829abedceca0ed8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e35151-29b1-46b9-bcfe-93d9cd41c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e35151-29b1-46b9-bcfe-93d9cd41c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63da48aa-490b-4793-a5d5-e7e6de46cdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63da48aa-490b-4793-a5d5-e7e6de46cdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a1e011-0753-44eb-85a3-9e51ec7899c9', 'volume_name': 'volume-80a1e011-0753-44eb-85a3-9e51ec7899c9', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327f4113-8f83-4c2f-ac94-5ff0bf4bc835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327f4113-8f83-4c2f-ac94-5ff0bf4bc835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8076bdac-783d-4580-8537-015935bcbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:11 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Volume 80a1e011-0753-44eb-85a3-9e51ec7899c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a1e011-0753-44eb-85a3-9e51ec7899c9', 'volume_size': 1} Apr 16 11:32:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:12 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.513s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:12 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:12 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56" returned: 0 in 2.177s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:12 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d81946-4b2d-45f4-a78f-099fcbe11165]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:12 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 Apr 16 11:32:12 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:13 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37" returned: 0 in 0.594s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:32:13 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Converted 1024.00 MB image at 470.06 MB/s Apr 16 11:32:13 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 is being set with open permissions: ugo+rw Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:13 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 Apr 16 11:32:13 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:13 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56" returned: 0 in 0.410s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-f9992343-e418-43e1-9bba-07733d329d56" released by "_copy_volume_from_snapshot" :: held 4.185s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-b4b76a19-26bd-4fc4-a023-ab9b7779da03-f9992343-e418-43e1-9bba-07733d329d56" released by "_create_volume_from_snapshot" :: held 4.200s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.209s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.525s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1539063344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a1e011-0753-44eb-85a3-9e51ec7899c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfff8aac628c4aaca5c3c06d7447ff6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:11Z,use_quota=True,user_id='541fd16045a44003829abedceca0ed8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Creating volume 80a1e011-0753-44eb-85a3-9e51ec7899c9 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:13 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:13 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 1073741824 Apr 16 11:32:13 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adb4946-5434-431d-93d7-8f3a238b5bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9992343-e418-43e1-9bba-07733d329d56', 'volume_size': 1, 'snapshot_id': 'b4b76a19-26bd-4fc4-a023-ab9b7779da03'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8b646b-9b6c-4004-a622-00cd9e4b67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:13 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Volume volume-f9992343-e418-43e1-9bba-07733d329d56 (f9992343-e418-43e1-9bba-07733d329d56): created successfully Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8b646b-9b6c-4004-a622-00cd9e4b67cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Flow 'volume_create_manager' (287ffd43-0bb2-41d4-8f55-595915b5d85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:13 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-20d58595-6418-46a1-8919-5dcffac7ff9d tempest-SnapshotDependencyTests-1263282125 None] Created volume successfully. Apr 16 11:32:14 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 1073741824" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:14 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 Apr 16 11:32:14 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:14 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9" returned: 0 in 0.408s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8076bdac-783d-4580-8537-015935bcbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a1e011-0753-44eb-85a3-9e51ec7899c9', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d357d936-3004-4ca0-9e0e-a276d330f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:14 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Volume volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 (80a1e011-0753-44eb-85a3-9e51ec7899c9): created successfully Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d357d936-3004-4ca0-9e0e-a276d330f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Flow 'volume_create_manager' (e675a4af-5fd2-4c92-8f87-5cf886618865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-b4b76a19-26bd-4fc4-a023-ab9b7779da03-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-500e6ad8-578f-4b2d-87e8-24c54f37c83a tempest-VolumesTransfersV355Test-421913597 None] Created volume successfully. Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-b4b76a19-26bd-4fc4-a023-ab9b7779da03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-quobyte-3b1fb1d5-1f22-4249-b781-596cfbad3b37" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-3b1fb1d5-1f22-4249-b781-596cfbad3b37" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-quobyte-b4b76a19-26bd-4fc4-a023-ab9b7779da03" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-b4b76a19-26bd-4fc4-a023-ab9b7779da03" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Deleting offline snapshot b4b76a19-26bd-4fc4-a023-ab9b7779da03 of volume 3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] snapshot_file for this snap is: volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[10339fd0-e70a-4877-a5e7-a12c382ce472]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:14 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 Apr 16 11:32:14 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:15 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03" returned: 0 in 0.479s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b5fdd-7d78-4ecd-9bb7-b3b273ed5917]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:15 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 Apr 16 11:32:15 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Acquiring lock "cinder-80a1e011-0753-44eb-85a3-9e51ec7899c9-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-80a1e011-0753-44eb-85a3-9e51ec7899c9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Acquiring lock "cinder-quobyte-80a1e011-0753-44eb-85a3-9e51ec7899c9" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-quobyte-80a1e011-0753-44eb-85a3-9e51ec7899c9" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc05a7-d4a7-4e53-a202-caa27afaaee4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:15 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 Apr 16 11:32:15 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:15 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37" returned: 0 in 0.495s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:15 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 Apr 16 11:32:15 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:15 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9" returned: 0 in 0.473s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:15 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9 Apr 16 11:32:15 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:16 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03" returned: 0 in 0.458s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:16 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03 Apr 16 11:32:16 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:16 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-80a1e011-0753-44eb-85a3-9e51ec7899c9" returned: 0 in 0.423s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-quobyte-80a1e011-0753-44eb-85a3-9e51ec7899c9" released by "delete_volume" :: held 0.927s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Created reservations ['08416600-2788-4313-bd76-fc12ac8e8d6d', 'fe155229-584c-462d-acd4-7738386f6261', 'e6ef29e5-4822-40f5-a011-551e653903b4', '22d46284-ccba-4203-8f9d-8deb37727a10'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:16 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:16 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:16 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37.b4b76a19-26bd-4fc4-a023-ab9b7779da03" returned: 0 in 0.435s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-b4b76a19-26bd-4fc4-a023-ab9b7779da03" released by "_delete_snapshot" :: held 1.926s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-3b1fb1d5-1f22-4249-b781-596cfbad3b37" released by "delete_snapshot" :: held 1.937s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Created reservations ['06e86a4d-62ab-4a81-ae41-903a78ad3629', 'cd027036-8bcb-468d-b6f9-3a0e9eb9599e', '1ba4a405-bd41-4047-a468-5aec60b76da0', '161ba2d1-a2fd-4f71-887b-7ad875fde3bf'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Delete snapshot completed successfully. Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5e1e20aa-2d8c-4fb7-9122-f7204068083e tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-b4b76a19-26bd-4fc4-a023-ab9b7779da03-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-3b1fb1d5-1f22-4249-b781-596cfbad3b37-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-3b1fb1d5-1f22-4249-b781-596cfbad3b37-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-quobyte-3b1fb1d5-1f22-4249-b781-596cfbad3b37" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-3b1fb1d5-1f22-4249-b781-596cfbad3b37" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f160e2f-6b77-433a-a689-2fc4db0bfd48]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:16 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 Apr 16 11:32:16 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:16 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.462s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Deleted volume successfully. Apr 16 11:32:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-be3c5325-42d0-43e0-9ffc-051e9bc91d69 tempest-VolumesTransfersV355Test-1762876995 None] Lock "cinder-80a1e011-0753-44eb-85a3-9e51ec7899c9-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:17 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:17 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37 Apr 16 11:32:17 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:17 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3b1fb1d5-1f22-4249-b781-596cfbad3b37" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-3b1fb1d5-1f22-4249-b781-596cfbad3b37" released by "delete_volume" :: held 0.998s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Created reservations ['ea085e28-ab0c-4383-924a-476746912adf', '608c3f18-952b-48d1-a7a1-b951996a94db', 'ded4b4f8-72b0-4284-a0f8-cabd3808a45e', 'f022bb15-07e8-4c99-a828-256eaa4c1d08'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:17 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:17 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:18 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.450s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Deleted volume successfully. Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-dad36c98-2783-4c4a-939a-b3a949b44814 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-3b1fb1d5-1f22-4249-b781-596cfbad3b37-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-f9992343-e418-43e1-9bba-07733d329d56-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-f9992343-e418-43e1-9bba-07733d329d56-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "cinder-quobyte-f9992343-e418-43e1-9bba-07733d329d56" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-f9992343-e418-43e1-9bba-07733d329d56" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4aa390-cc29-46be-b5d0-cb6897461159]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:18 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 Apr 16 11:32:18 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:19 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56" returned: 0 in 0.508s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:19 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56 Apr 16 11:32:19 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Flow 'volume_create_manager' (e902c3e9-21b9-4b10-af96-93fb2798f768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a424c4-3df4-4735-830e-00dedcafce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a424c4-3df4-4735-830e-00dedcafce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1425505641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c517e8-6383-4769-b1cc-696eec53ed5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fdded10a4444c3b96122d9ad4e2cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:20Z,use_quota=True,user_id='7ccaf3237d014d649c9bff87ab5a8d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:19 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8741c50d-2891-4d5f-b7b0-34c04a900646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8741c50d-2891-4d5f-b7b0-34c04a900646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff18d590-a2eb-4e98-a91e-3b0dca73592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff18d590-a2eb-4e98-a91e-3b0dca73592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c517e8-6383-4769-b1cc-696eec53ed5e', 'volume_name': 'volume-f5c517e8-6383-4769-b1cc-696eec53ed5e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcdf360-2959-4640-ace9-4be017f52a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcdf360-2959-4640-ace9-4be017f52a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c471fa-be05-46a1-8b67-78a7390005c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:19 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Volume f5c517e8-6383-4769-b1cc-696eec53ed5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c517e8-6383-4769-b1cc-696eec53ed5e', 'volume_size': 1} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1425505641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c517e8-6383-4769-b1cc-696eec53ed5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fdded10a4444c3b96122d9ad4e2cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:20Z,use_quota=True,user_id='7ccaf3237d014d649c9bff87ab5a8d13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Creating volume f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:19 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9992343-e418-43e1-9bba-07733d329d56" returned: 0 in 0.482s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-quobyte-f9992343-e418-43e1-9bba-07733d329d56" released by "delete_volume" :: held 1.021s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:19 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e 1073741824 Apr 16 11:32:19 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:19 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Created reservations ['f116e7f1-c125-4a3a-bd6b-ea48b81ed438', 'f85bce65-2094-4e8d-9105-7d99352ed680', '1099a6d9-f902-40a4-934d-b44448780588', '5e6d796d-fd06-4204-89ac-67347570cd4e'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:20 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:20 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:20 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e 1073741824" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:20 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Deleted volume successfully. Apr 16 11:32:20 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e Apr 16 11:32:20 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a9560bf8-450b-4cd1-894a-a87b3097bdf4 tempest-SnapshotDependencyTests-1263282125 None] Lock "cinder-f9992343-e418-43e1-9bba-07733d329d56-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:20 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e" returned: 0 in 0.409s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c471fa-be05-46a1-8b67-78a7390005c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c517e8-6383-4769-b1cc-696eec53ed5e', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff730311-4300-440b-945c-286a0cd6cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:20 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Volume volume-f5c517e8-6383-4769-b1cc-696eec53ed5e (f5c517e8-6383-4769-b1cc-696eec53ed5e): created successfully Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff730311-4300-440b-945c-286a0cd6cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Flow 'volume_create_manager' (e902c3e9-21b9-4b10-af96-93fb2798f768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f8d81125-8ec9-4d5b-9586-1b9a9a72df5c tempest-VolumesSnapshotListTestJSON-1407039351 None] Created volume successfully. Apr 16 11:32:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Creating offline snapshot 9541f66a-2847-49ea-a6b4-ee54523d0508 of volume f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:32:22 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa2fb8d-77a3-438c-ab8a-7c145977e06a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:22 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e Apr 16 11:32:22 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:22 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:22 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 1G Apr 16 11:32:22 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:23 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 1G" returned: 0 in 0.546s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:23 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 Apr 16 11:32:23 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:23 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508" returned: 0 in 0.437s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:23 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 is being set with open permissions: ugo+rw Apr 16 11:32:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:23 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 Apr 16 11:32:23 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:24 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508" returned: 0 in 0.452s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:24 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.info Apr 16 11:32:24 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:24 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.info" returned: 0 in 0.450s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:24 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.info is being set with open permissions: ugo+rw Apr 16 11:32:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:24 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.info Apr 16 11:32:24 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:24 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.info" returned: 0 in 0.473s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:25 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-056aca3f-d26d-499c-b69f-8d38f2477f8d tempest-VolumesSnapshotListTestJSON-1407039351 None] Create snapshot completed successfully Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Creating offline snapshot c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 of volume f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec51e6-d3b8-44a7-9d32-1d26fc3449f7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:25 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 Apr 16 11:32:25 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:25 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508" returned: 0 in 0.572s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c517e8-6383-4769-b1cc-696eec53ed5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:25 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 1G Apr 16 11:32:25 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:26 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 1G" returned: 0 in 0.539s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:26 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 Apr 16 11:32:26 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:26 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:26 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 is being set with open permissions: ugo+rw Apr 16 11:32:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:26 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 Apr 16 11:32:26 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:27 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" returned: 0 in 0.424s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:27 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e2e0515f-aa79-4706-992b-7af1ffc2e9bb tempest-VolumesSnapshotListTestJSON-1407039351 None] Create snapshot completed successfully Apr 16 11:32:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Creating offline snapshot 67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 of volume f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:32:28 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa7629-a7e5-4f3d-9965-4c262b98bedc]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:28 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 Apr 16 11:32:28 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:29 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" returned: 0 in 0.454s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c517e8-6383-4769-b1cc-696eec53ed5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:29 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 1G Apr 16 11:32:29 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:29 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 1G" returned: 0 in 0.474s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:29 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 Apr 16 11:32:29 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:29 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" returned: 0 in 0.420s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:29 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 is being set with open permissions: ugo+rw Apr 16 11:32:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:29 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 Apr 16 11:32:29 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:30 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" returned: 0 in 0.397s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-397d4517-cce4-4996-8121-0b2c4024d4b0 tempest-VolumesSnapshotListTestJSON-1407039351 None] Create snapshot completed successfully Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-67e6f1d3-b7ed-4cdb-adf6-e58528f3af14-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-67e6f1d3-b7ed-4cdb-adf6-e58528f3af14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-quobyte-67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Deleting offline snapshot 67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 of volume f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] snapshot_file for this snap is: volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e3ed2d-1e74-4724-9c72-a30626b3ed6d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:31 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 Apr 16 11:32:31 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:31 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c517e8-6383-4769-b1cc-696eec53ed5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca5e0e8-5e5f-496b-8a3b-d7b432c3699f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:32 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 Apr 16 11:32:32 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:32 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" returned: 0 in 0.458s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c517e8-6383-4769-b1cc-696eec53ed5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:32 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 Apr 16 11:32:32 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:32 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:32 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14 Apr 16 11:32:32 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:33 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" returned: 0 in 0.401s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-67e6f1d3-b7ed-4cdb-adf6-e58528f3af14" released by "_delete_snapshot" :: held 1.824s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" released by "delete_snapshot" :: held 1.835s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Created reservations ['9da8b968-ae69-4c22-a1a2-155d418ce8cc', 'c1728ae9-c22a-41f5-881b-dca25ecd277c', '4dcc47a9-d67c-40a7-8e16-e7c1a805c65f', 'd0457777-1c90-4585-b3f7-e875ffc94939'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:33 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Delete snapshot completed successfully. Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ae690048-a08c-44a6-b3f6-f5367bf61feb tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-67e6f1d3-b7ed-4cdb-adf6-e58528f3af14-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-c7928ffe-fb1d-4d7b-8aa5-7dfd51935675-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-c7928ffe-fb1d-4d7b-8aa5-7dfd51935675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" acquired by "delete_snapshot" :: waited 0.005s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-quobyte-c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Deleting offline snapshot c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 of volume f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] snapshot_file for this snap is: volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d7138-207f-4258-a783-55fd737d3d43]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:33 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 Apr 16 11:32:33 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:34 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c517e8-6383-4769-b1cc-696eec53ed5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[89115da3-283e-41c5-9369-fb249753499f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:34 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 Apr 16 11:32:34 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:34 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508" returned: 0 in 0.451s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c517e8-6383-4769-b1cc-696eec53ed5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:34 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 Apr 16 11:32:34 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:34 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" returned: 0 in 0.458s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:34 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675 Apr 16 11:32:34 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:35 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" returned: 0 in 0.414s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-c7928ffe-fb1d-4d7b-8aa5-7dfd51935675" released by "_delete_snapshot" :: held 1.829s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" released by "delete_snapshot" :: held 1.839s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Created reservations ['60761ae9-e840-424f-a78c-5cfc1d14aaff', 'f7ca7d62-112c-43c1-9cce-eb236ccaea2b', '29ff6807-b6d9-4337-874e-68a0c3ebfd9e', 'c172e8de-12c2-4e5b-8884-8d09ccfcd209'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Delete snapshot completed successfully. Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8a0e227e-fd31-4fd0-99ff-71f5b4a03b37 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-c7928ffe-fb1d-4d7b-8aa5-7dfd51935675-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-9541f66a-2847-49ea-a6b4-ee54523d0508-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-9541f66a-2847-49ea-a6b4-ee54523d0508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-quobyte-9541f66a-2847-49ea-a6b4-ee54523d0508" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-9541f66a-2847-49ea-a6b4-ee54523d0508" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Deleting offline snapshot 9541f66a-2847-49ea-a6b4-ee54523d0508 of volume f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] snapshot_file for this snap is: volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[53093dd9-124f-4b2b-a516-5588b0c8defe]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:35 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 Apr 16 11:32:35 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:36 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c517e8-6383-4769-b1cc-696eec53ed5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7e26e-2673-4848-b947-c7ac0ee1862a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:36 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e Apr 16 11:32:36 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:36 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e" returned: 0 in 0.456s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:36 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 Apr 16 11:32:36 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:37 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:37 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508 Apr 16 11:32:37 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:37 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e.9541f66a-2847-49ea-a6b4-ee54523d0508" returned: 0 in 0.399s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-9541f66a-2847-49ea-a6b4-ee54523d0508" released by "_delete_snapshot" :: held 1.827s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" released by "delete_snapshot" :: held 1.839s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Created reservations ['414f7ec6-35ba-4264-985b-9f0d573a6fac', '92dc5439-2a6f-482a-a7b0-95b325dc4a5d', '85c55a57-29a0-4787-b610-c227b60a9a46', '55606750-a796-431d-9298-f0648da1282d'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:37 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Delete snapshot completed successfully. Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9fed7a3e-d6f7-434d-8677-8e29c022cec8 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-9541f66a-2847-49ea-a6b4-ee54523d0508-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-f5c517e8-6383-4769-b1cc-696eec53ed5e-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-f5c517e8-6383-4769-b1cc-696eec53ed5e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac14219-a2de-438e-9c8c-1a87dfae8367]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:37 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e Apr 16 11:32:37 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:38 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e" returned: 0 in 0.470s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:38 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e Apr 16 11:32:38 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:38 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f5c517e8-6383-4769-b1cc-696eec53ed5e" returned: 0 in 0.410s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-quobyte-f5c517e8-6383-4769-b1cc-696eec53ed5e" released by "delete_volume" :: held 0.915s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Created reservations ['1dc41d78-cedd-4f14-b426-270a21cc4ea0', '21f356ff-fb73-4d8f-b46c-dad31a16c809', '9bfc660a-0f05-4b6e-b5a1-b6f55e6e6821', '9ff4abf0-eb66-4b7d-beed-f64f45bc6e11'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:38 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:38 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:39 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.466s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:39 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:39 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Deleted volume successfully. Apr 16 11:32:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5398d444-2183-41e7-b978-1355d8291dc9 tempest-VolumesSnapshotListTestJSON-1407039351 None] Lock "cinder-f5c517e8-6383-4769-b1cc-696eec53ed5e-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Flow 'volume_create_manager' (43cff258-c9ab-4ddc-a11d-171a797c0348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea6ca0f-10ef-4be7-9b49-4b99da3ee9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea6ca0f-10ef-4be7-9b49-4b99da3ee9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-266569323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ba117f-856f-4e6f-9524-a6430c6bb015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3397965e174530b5efc6f1dc2086ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:41Z,use_quota=True,user_id='470f7bd5091441dcbc3ba1b8571acd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eae154-98a2-4ac6-a77e-b5017017aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eae154-98a2-4ac6-a77e-b5017017aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9a19bd-fcf3-4ab9-a231-96cd7dade8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9a19bd-fcf3-4ab9-a231-96cd7dade8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ba117f-856f-4e6f-9524-a6430c6bb015', 'volume_name': 'volume-70ba117f-856f-4e6f-9524-a6430c6bb015', 'volume_size': 2}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e792e3-91a0-4200-a9d1-c5649df77454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e792e3-91a0-4200-a9d1-c5649df77454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6fa80f-a5fe-4e22-867f-98c15999a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:40 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Volume 70ba117f-856f-4e6f-9524-a6430c6bb015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ba117f-856f-4e6f-9524-a6430c6bb015', 'volume_size': 2} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-266569323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ba117f-856f-4e6f-9524-a6430c6bb015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3397965e174530b5efc6f1dc2086ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:41Z,use_quota=True,user_id='470f7bd5091441dcbc3ba1b8571acd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Creating volume 70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:40 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 2147483648 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:40 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 2147483648 Apr 16 11:32:40 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:41 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 2147483648" returned: 0 in 0.493s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:41 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 Apr 16 11:32:41 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:41 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015" returned: 0 in 0.416s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6fa80f-a5fe-4e22-867f-98c15999a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ba117f-856f-4e6f-9524-a6430c6bb015', 'volume_size': 2}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085da64c-ad6a-4192-a44f-2e90a911973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:41 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Volume volume-70ba117f-856f-4e6f-9524-a6430c6bb015 (70ba117f-856f-4e6f-9524-a6430c6bb015): created successfully Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085da64c-ad6a-4192-a44f-2e90a911973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Flow 'volume_create_manager' (43cff258-c9ab-4ddc-a11d-171a797c0348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:41 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-217e9439-391c-46c6-b72e-3dd87fcdb174 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Created volume successfully. Apr 16 11:32:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Creating offline snapshot 8fb49652-dafc-4d84-9973-87d96402c22b of volume 70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:32:42 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b7b01-105d-47fc-9a6e-3fb37cc81a62]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:42 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 Apr 16 11:32:42 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:43 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b 2G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:43 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b 2G Apr 16 11:32:43 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:43 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b 2G" returned: 0 in 0.451s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ba117f-856f-4e6f-9524-a6430c6bb015 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:43 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ba117f-856f-4e6f-9524-a6430c6bb015 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b Apr 16 11:32:43 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:44 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ba117f-856f-4e6f-9524-a6430c6bb015 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b" returned: 0 in 0.419s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:44 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b is being set with open permissions: ugo+rw Apr 16 11:32:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:44 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b Apr 16 11:32:44 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:44 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b" returned: 0 in 0.403s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:44 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.info Apr 16 11:32:44 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:44 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.info" returned: 0 in 0.404s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:44 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.info is being set with open permissions: ugo+rw Apr 16 11:32:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:45 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.info Apr 16 11:32:45 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:45 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.info" returned: 0 in 0.403s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:45 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bebfe20d-f437-4907-a48b-75f0ce6973ec tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Create snapshot completed successfully Apr 16 11:32:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "cinder-8fb49652-dafc-4d84-9973-87d96402c22b-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-8fb49652-dafc-4d84-9973-87d96402c22b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "cinder-quobyte-70ba117f-856f-4e6f-9524-a6430c6bb015" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-quobyte-70ba117f-856f-4e6f-9524-a6430c6bb015" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:45 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "cinder-quobyte-8fb49652-dafc-4d84-9973-87d96402c22b" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-quobyte-8fb49652-dafc-4d84-9973-87d96402c22b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Deleting offline snapshot 8fb49652-dafc-4d84-9973-87d96402c22b of volume 70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] snapshot_file for this snap is: volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0a01b9-6f3f-41cc-8981-b1c4ff6abdf8]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:46 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b Apr 16 11:32:46 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:46 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b" returned: 0 in 0.460s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ba117f-856f-4e6f-9524-a6430c6bb015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af3c32-7ac7-49bc-8793-89c0a6fad992]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:46 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 Apr 16 11:32:46 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:46 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015" returned: 0 in 0.458s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:46 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b Apr 16 11:32:46 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:47 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b" returned: 0 in 0.453s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:47 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b Apr 16 11:32:47 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:47 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015.8fb49652-dafc-4d84-9973-87d96402c22b" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-quobyte-8fb49652-dafc-4d84-9973-87d96402c22b" released by "_delete_snapshot" :: held 1.827s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-quobyte-70ba117f-856f-4e6f-9524-a6430c6bb015" released by "delete_snapshot" :: held 1.843s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:47 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Created reservations ['daff4203-4461-46fe-a29a-032c43303dc7', 'bd732506-3e77-4e2f-9e9e-13634ca34e9c', 'd5d4c434-c5b4-469e-99ab-14fa64ed19bf', 'fa76188a-4e0b-47c6-b2bc-583d09fe1676'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Delete snapshot completed successfully. Apr 16 11:32:47 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-4510d132-1bc1-4277-902b-60031566d659 tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-8fb49652-dafc-4d84-9973-87d96402c22b-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "cinder-70ba117f-856f-4e6f-9524-a6430c6bb015-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-70ba117f-856f-4e6f-9524-a6430c6bb015-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "cinder-quobyte-70ba117f-856f-4e6f-9524-a6430c6bb015" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-quobyte-70ba117f-856f-4e6f-9524-a6430c6bb015" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8750f10-5ad2-41df-8b32-779a1552e1f2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:48 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 Apr 16 11:32:48 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:48 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015" returned: 0 in 0.466s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:48 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015 Apr 16 11:32:48 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:49 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-70ba117f-856f-4e6f-9524-a6430c6bb015" returned: 0 in 0.397s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-quobyte-70ba117f-856f-4e6f-9524-a6430c6bb015" released by "delete_volume" :: held 0.897s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Created reservations ['76d95c62-9b5c-4a58-9a2b-878bfd7593cb', 'b33c801a-3d87-4e4c-b3cb-7d766a710826', '57d79025-810b-4ebe-8573-37aacfa9c1e8', '0d3ffdff-46c1-41fc-b5c8-e43f043e77c2'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:49 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:49 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:49 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:49 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Deleted volume successfully. Apr 16 11:32:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-7e9a6a91-cc26-428f-9085-8e5ae70d191e tempest-VolumesSnapshotNegativeTestJSON-1054070340 None] Lock "cinder-70ba117f-856f-4e6f-9524-a6430c6bb015-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (d5c0dd26-9fb5-4ac7-8d2f-4465da03c27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91ea587-61f5-43c7-923d-a73040e4c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91ea587-61f5-43c7-923d-a73040e4c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370818312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d28efe4-4c3d-43f4-8a49-37e8ed50770f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f67b0b9-e2a2-4e57-83a3-59c7d4b7f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f67b0b9-e2a2-4e57-83a3-59c7d4b7f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7baa9f4-1233-4b19-81e1-750928dbb82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7baa9f4-1233-4b19-81e1-750928dbb82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d28efe4-4c3d-43f4-8a49-37e8ed50770f', 'volume_name': 'volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df142cc6-3ded-490f-a85d-00cd01d9f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df142cc6-3ded-490f-a85d-00cd01d9f133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a21837d-32a8-48db-b2eb-cc9e2a779de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:50 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Volume 4d28efe4-4c3d-43f4-8a49-37e8ed50770f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f', 'volume_size': 1} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370818312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d28efe4-4c3d-43f4-8a49-37e8ed50770f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Creating volume 4d28efe4-4c3d-43f4-8a49-37e8ed50770f {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:50 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:50 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f 1073741824 Apr 16 11:32:50 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:50 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (c615c1ab-70d5-45cd-8cf9-1cb37ead8c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0203e103-4bc1-44e7-8822-4fe7439f7c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0203e103-4bc1-44e7-8822-4fe7439f7c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255153275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af5f076-aea7-4136-868a-42475542215a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b553709-bce8-4c69-a560-06a42cac1e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b553709-bce8-4c69-a560-06a42cac1e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187bb551-e9eb-4682-8382-f109b161ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187bb551-e9eb-4682-8382-f109b161ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af5f076-aea7-4136-868a-42475542215a', 'volume_name': 'volume-3af5f076-aea7-4136-868a-42475542215a', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67021a5d-d53c-46de-a160-4b83fd3460a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67021a5d-d53c-46de-a160-4b83fd3460a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520828c6-f33b-47a1-a700-23a46e5e6af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Volume 3af5f076-aea7-4136-868a-42475542215a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af5f076-aea7-4136-868a-42475542215a', 'volume_size': 1} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (9d71800e-4b6f-4a1f-9832-534b947f6309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efd3236-8d34-4baa-8758-2ff9a4559fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efd3236-8d34-4baa-8758-2ff9a4559fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-782521685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3523bb9f-dc17-44b5-83cd-728ea5352c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e755bf3f-479e-4580-9ddf-fe30803715c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e755bf3f-479e-4580-9ddf-fe30803715c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd1e1f5-8949-419a-a5af-cd91a4243f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd1e1f5-8949-419a-a5af-cd91a4243f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3523bb9f-dc17-44b5-83cd-728ea5352c1f', 'volume_name': 'volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdd5251-cb9d-4553-bdae-1881e3b62378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdd5251-cb9d-4553-bdae-1881e3b62378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f833d5-5870-4036-ba0f-c3d7ad5a22ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Volume 3523bb9f-dc17-44b5-83cd-728ea5352c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f', 'volume_size': 1} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (b908e22f-d05f-4a0d-88cb-7e32d0c454f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bf99be-fd3f-4711-86e9-fff929e94a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bf99be-fd3f-4711-86e9-fff929e94a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865373778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc4219d-cf5d-4828-971e-5b21532e8979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bf2ba1-285b-4d26-869d-9282e5fb73da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bf2ba1-285b-4d26-869d-9282e5fb73da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22256f3-866a-4d4d-b967-b9daff03c992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22256f3-866a-4d4d-b967-b9daff03c992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc4219d-cf5d-4828-971e-5b21532e8979', 'volume_name': 'volume-4dc4219d-cf5d-4828-971e-5b21532e8979', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c44e99a-cd61-4f76-9bac-7ff33ba752a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c44e99a-cd61-4f76-9bac-7ff33ba752a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfbae2b-78d4-4a69-858d-dc4b4ab63edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Volume 4dc4219d-cf5d-4828-971e-5b21532e8979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc4219d-cf5d-4828-971e-5b21532e8979', 'volume_size': 1} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:51 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f 1073741824" returned: 0 in 0.595s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:51 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f Apr 16 11:32:51 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (b01b7acd-845f-495f-b5d6-ae4f58b874fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4197c0b-6ae6-4e9b-97d8-faa14c735350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4197c0b-6ae6-4e9b-97d8-faa14c735350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356435285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8022f6a-65d8-47f8-9ece-bf9197ea8485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:52Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91378e78-3873-4d7a-9332-fc0c4dcaf119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91378e78-3873-4d7a-9332-fc0c4dcaf119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee7dba9-e863-4e1b-9b44-be44631af67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee7dba9-e863-4e1b-9b44-be44631af67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8022f6a-65d8-47f8-9ece-bf9197ea8485', 'volume_name': 'volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a516acf0-98c3-46b7-87a7-5adba90bac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a516acf0-98c3-46b7-87a7-5adba90bac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb784a53-6865-43cb-a0da-b4319b78203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Volume c8022f6a-65d8-47f8-9ece-bf9197ea8485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485', 'volume_size': 1} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:51 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f" returned: 0 in 0.425s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255153275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af5f076-aea7-4136-868a-42475542215a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Creating volume 3af5f076-aea7-4136-868a-42475542215a {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:51 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a21837d-32a8-48db-b2eb-cc9e2a779de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a 1073741824 Apr 16 11:32:51 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9b1cb9-3570-450d-b584-2440f620da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:51 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Volume volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f (4d28efe4-4c3d-43f4-8a49-37e8ed50770f): created successfully Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9b1cb9-3570-450d-b584-2440f620da96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:51 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (d5c0dd26-9fb5-4ac7-8d2f-4465da03c27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:51 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bedf1927-729b-4e0f-a7eb-ff94a3aed049 tempest-CreateVolumesFromImageTest-1841997757 None] Created volume successfully. Apr 16 11:32:52 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a 1073741824" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:52 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a Apr 16 11:32:52 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:52 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a" returned: 0 in 0.417s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-782521685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3523bb9f-dc17-44b5-83cd-728ea5352c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Creating volume 3523bb9f-dc17-44b5-83cd-728ea5352c1f {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:52 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520828c6-f33b-47a1-a700-23a46e5e6af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af5f076-aea7-4136-868a-42475542215a', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:52 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f 1073741824 Apr 16 11:32:52 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec753d7a-65bb-4cb9-ac8a-ebb9fef7dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Volume volume-3af5f076-aea7-4136-868a-42475542215a (3af5f076-aea7-4136-868a-42475542215a): created successfully Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec753d7a-65bb-4cb9-ac8a-ebb9fef7dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (c615c1ab-70d5-45cd-8cf9-1cb37ead8c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-74f314b5-f1db-49b5-bb99-6385dcae57a6 tempest-CreateVolumesFromImageTest-1841997757 None] Created volume successfully. Apr 16 11:32:53 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f 1073741824" returned: 0 in 0.461s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:53 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f Apr 16 11:32:53 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:53 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f" returned: 0 in 0.412s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.330s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865373778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc4219d-cf5d-4828-971e-5b21532e8979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:51Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Creating volume 4dc4219d-cf5d-4828-971e-5b21532e8979 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:53 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f833d5-5870-4036-ba0f-c3d7ad5a22ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:53 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 1073741824 Apr 16 11:32:53 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5f7470-3581-4639-9159-a28300a5deb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:53 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Volume volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f (3523bb9f-dc17-44b5-83cd-728ea5352c1f): created successfully Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5f7470-3581-4639-9159-a28300a5deb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (9d71800e-4b6f-4a1f-9832-534b947f6309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-4304db46-7b9e-48ff-b295-0ad853f519b4 tempest-CreateVolumesFromImageTest-1841997757 None] Created volume successfully. Apr 16 11:32:54 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 1073741824" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:54 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 Apr 16 11:32:54 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:54 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979" returned: 0 in 0.395s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356435285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8022f6a-65d8-47f8-9ece-bf9197ea8485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28a503545914cd888a89e72fc1e982a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:32:52Z,use_quota=True,user_id='18f73dadbe8a48b2ba5fe4e0f352a92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Creating volume c8022f6a-65d8-47f8-9ece-bf9197ea8485 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:32:54 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfbae2b-78d4-4a69-858d-dc4b4ab63edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc4219d-cf5d-4828-971e-5b21532e8979', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:54 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 1073741824 Apr 16 11:32:54 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445641fe-8d35-4e71-93f9-507c611fd3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:54 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Volume volume-4dc4219d-cf5d-4828-971e-5b21532e8979 (4dc4219d-cf5d-4828-971e-5b21532e8979): created successfully Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445641fe-8d35-4e71-93f9-507c611fd3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (b908e22f-d05f-4a0d-88cb-7e32d0c454f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dd200cc4-e593-421f-bdb6-0f29dccd4b4f tempest-CreateVolumesFromImageTest-1841997757 None] Created volume successfully. Apr 16 11:32:55 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 1073741824" returned: 0 in 0.472s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:55 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 Apr 16 11:32:55 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:55 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485" returned: 0 in 0.395s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb784a53-6865-43cb-a0da-b4319b78203b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4661130d-73ab-4035-b2e1-8855766e07b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:32:55 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Volume volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 (c8022f6a-65d8-47f8-9ece-bf9197ea8485): created successfully Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4661130d-73ab-4035-b2e1-8855766e07b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Flow 'volume_create_manager' (b01b7acd-845f-495f-b5d6-ae4f58b874fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:32:55 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6f6df661-6971-4a56-b6f7-f9f3e2ea7a38 tempest-CreateVolumesFromImageTest-1841997757 None] Created volume successfully. Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-c8022f6a-65d8-47f8-9ece-bf9197ea8485-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-c8022f6a-65d8-47f8-9ece-bf9197ea8485-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-quobyte-c8022f6a-65d8-47f8-9ece-bf9197ea8485" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-c8022f6a-65d8-47f8-9ece-bf9197ea8485" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[72381f6f-5d92-4077-944b-3a7d6a2da155]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:56 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 Apr 16 11:32:56 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:56 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485" returned: 0 in 0.456s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:56 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485 Apr 16 11:32:56 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:56 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c8022f6a-65d8-47f8-9ece-bf9197ea8485" returned: 0 in 0.396s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-c8022f6a-65d8-47f8-9ece-bf9197ea8485" released by "delete_volume" :: held 0.872s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Created reservations ['3943e9bd-6d3a-479a-9101-18e14d0e5f8f', '91359aca-c496-47eb-be06-8cd556609b2c', '91427411-3a0d-43cc-9447-99e13f19c058', 'c617b0e3-9ffa-4230-90e2-5b2aa94affc1'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:56 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:56 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-4dc4219d-cf5d-4828-971e-5b21532e8979-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-4dc4219d-cf5d-4828-971e-5b21532e8979-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-quobyte-4dc4219d-cf5d-4828-971e-5b21532e8979" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-4dc4219d-cf5d-4828-971e-5b21532e8979" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12f6836-799e-4dda-867e-56eb552a4893]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:57 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 Apr 16 11:32:57 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:57 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.419s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Deleted volume successfully. Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-949272b1-8009-4015-9697-7fa00212ec20 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-c8022f6a-65d8-47f8-9ece-bf9197ea8485-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:57 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979" returned: 0 in 0.469s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:57 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979 Apr 16 11:32:57 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:57 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4dc4219d-cf5d-4828-971e-5b21532e8979" returned: 0 in 0.407s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-4dc4219d-cf5d-4828-971e-5b21532e8979" released by "delete_volume" :: held 0.896s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Created reservations ['51b688d4-a249-4686-8f7a-6dec6c5b9976', 'a802a302-fe1b-44ec-835c-dd1e77dd99d1', '077bdc87-cd38-4885-92fe-1d017097440b', 'ad1bfffd-e1a9-4ee9-9c0c-4f9f93d7a989'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:58 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:58 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-3523bb9f-dc17-44b5-83cd-728ea5352c1f-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-3523bb9f-dc17-44b5-83cd-728ea5352c1f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-quobyte-3523bb9f-dc17-44b5-83cd-728ea5352c1f" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-3523bb9f-dc17-44b5-83cd-728ea5352c1f" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3fdc4e-8443-49e6-b429-b016b9558dcb]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:58 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f Apr 16 11:32:58 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:58 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.409s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Deleted volume successfully. Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-57de3af1-c5f1-447a-b0da-1fff94aae54e tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-4dc4219d-cf5d-4828-971e-5b21532e8979-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:58 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f" returned: 0 in 0.461s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:58 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f Apr 16 11:32:58 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:59 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3523bb9f-dc17-44b5-83cd-728ea5352c1f" returned: 0 in 0.390s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-3523bb9f-dc17-44b5-83cd-728ea5352c1f" released by "delete_volume" :: held 0.871s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Created reservations ['72116636-f839-476e-a602-22a8aa7d0e95', '2ec9610c-1956-4904-b573-969248efec19', '0dc073ad-eb33-4e35-a984-0027c37f6178', '07e0d931-df0f-4953-8cde-7f7749259a46'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:59 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:32:59 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-3af5f076-aea7-4136-868a-42475542215a-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-3af5f076-aea7-4136-868a-42475542215a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-quobyte-3af5f076-aea7-4136-868a-42475542215a" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-3af5f076-aea7-4136-868a-42475542215a" acquired by "delete_volume" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf45971-dae8-463b-b597-4a487a67c7df]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:59 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a Apr 16 11:32:59 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:32:59 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:32:59 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Deleted volume successfully. Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0a0a6770-d8b5-4e83-afe5-c9206dfa5698 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-3523bb9f-dc17-44b5-83cd-728ea5352c1f-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:32:59 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:32:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:32:59 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a Apr 16 11:32:59 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:00 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3af5f076-aea7-4136-868a-42475542215a" returned: 0 in 0.393s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-3af5f076-aea7-4136-868a-42475542215a" released by "delete_volume" :: held 0.875s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Created reservations ['73080f91-de53-455a-95c5-5f689692c82b', '82084379-5615-4e00-ac54-86a205c9fc59', '3c049fd5-fe5b-4713-a0e1-78d6874c6383', 'bb78e2fb-d9d3-4ee6-a1e0-eb8fb9f19972'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:00 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:00 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-4d28efe4-4c3d-43f4-8a49-37e8ed50770f-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-4d28efe4-4c3d-43f4-8a49-37e8ed50770f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "cinder-quobyte-4d28efe4-4c3d-43f4-8a49-37e8ed50770f" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-4d28efe4-4c3d-43f4-8a49-37e8ed50770f" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaad716-b8d7-4648-b6a4-fe76d8bea67c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:00 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f Apr 16 11:33:00 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:00 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.431s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Deleted volume successfully. Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28decd3e-2a2b-498e-952f-ae82f6859e47 tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-3af5f076-aea7-4136-868a-42475542215a-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:00 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:00 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f Apr 16 11:33:01 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:01 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4d28efe4-4c3d-43f4-8a49-37e8ed50770f" returned: 0 in 0.426s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-quobyte-4d28efe4-4c3d-43f4-8a49-37e8ed50770f" released by "delete_volume" :: held 0.916s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Created reservations ['8e810ca9-1973-406a-b56f-ba671f98fc50', 'a1340000-df87-400c-8674-5b7cf3aca0a3', 'e59e2888-6281-43ae-b6ae-57666705c837', '9ab583ff-c152-4ad1-8162-013509e7ad7c'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:01 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:01 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:01 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:01 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:02 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Deleted volume successfully. Apr 16 11:33:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e49576b8-5f8b-47f2-9061-9e57a40e443d tempest-CreateVolumesFromImageTest-1841997757 None] Lock "cinder-4d28efe4-4c3d-43f4-8a49-37e8ed50770f-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (c1bd811c-2ecd-4e89-9e4d-286abf118f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5000bf47-4f72-4889-bf76-2ce548b13464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5000bf47-4f72-4889-bf76-2ce548b13464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468315487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a082cd-6f9b-463b-a014-0bb02e2f8f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:03Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7174d969-dd5e-48fc-b7f5-f17a5c5e8ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7174d969-dd5e-48fc-b7f5-f17a5c5e8ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd434208-a435-406f-9171-11f1a09e581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd434208-a435-406f-9171-11f1a09e581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a082cd-6f9b-463b-a014-0bb02e2f8f20', 'volume_name': 'volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bfab7d-0ade-4d7d-a6a7-eb9e77a17370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bfab7d-0ade-4d7d-a6a7-eb9e77a17370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87250889-3ae0-429d-a346-535ddf43bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:03 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume f9a082cd-6f9b-463b-a014-0bb02e2f8f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20', 'volume_size': 1} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-468315487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a082cd-6f9b-463b-a014-0bb02e2f8f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:03Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Creating volume f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:03 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:03 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 1073741824 Apr 16 11:33:03 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:03 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 1073741824" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:03 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 Apr 16 11:33:03 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:04 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" returned: 0 in 0.396s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87250889-3ae0-429d-a346-535ddf43bd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39feb999-d295-4552-827f-127e7230b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:04 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 (f9a082cd-6f9b-463b-a014-0bb02e2f8f20): created successfully Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39feb999-d295-4552-827f-127e7230b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (c1bd811c-2ecd-4e89-9e4d-286abf118f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:04 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-80f1cda8-944e-4b12-9e3a-04128e173fb1 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created volume successfully. Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Creating offline snapshot cbedab7d-b19e-4366-93a1-b50cf89720ac of volume f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de78c4a-e652-4031-814c-60b842d07182]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:04 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 Apr 16 11:33:04 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:04 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" returned: 0 in 0.470s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:04 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac 1G Apr 16 11:33:04 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:05 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac 1G" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:05 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac Apr 16 11:33:05 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:05 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac" returned: 0 in 0.422s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:05 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac is being set with open permissions: ugo+rw Apr 16 11:33:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:05 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac Apr 16 11:33:05 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:06 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac" returned: 0 in 0.407s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:06 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.info Apr 16 11:33:06 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:06 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.info" returned: 0 in 0.412s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:06 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.info is being set with open permissions: ugo+rw Apr 16 11:33:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:06 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.info Apr 16 11:33:06 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:07 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.info" returned: 0 in 0.407s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:07 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-887d1913-14f0-4b00-b537-5cd90053f7ce tempest-CreateVolumesFromSnapshotTest-289415383 None] Create snapshot completed successfully Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=131,cinder:DELETE=8,cinder:UPDATE=172,cinder:INSERT=45 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=106,cinder:UPDATE=133,cinder:INSERT=32,cinder:DELETE=19 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (262b1c8b-18cd-4180-96e2-6556f8dd973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd716019-5e7a-467e-925e-6ae6af194bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd716019-5e7a-467e-925e-6ae6af194bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1235606855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90e6389-e537-4d96-96bf-45502d087483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f25b752-3253-40df-b2a1-38c53ef1928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f25b752-3253-40df-b2a1-38c53ef1928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109d50aa-edfd-4021-bf44-254471e8a13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109d50aa-edfd-4021-bf44-254471e8a13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90e6389-e537-4d96-96bf-45502d087483', 'volume_name': 'volume-b90e6389-e537-4d96-96bf-45502d087483', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19097b94-9163-4e5b-a693-42638a6bc972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19097b94-9163-4e5b-a693-42638a6bc972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfc4423-8554-44b8-b2be-b5c77a927491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume b90e6389-e537-4d96-96bf-45502d087483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90e6389-e537-4d96-96bf-45502d087483', 'volume_size': 1} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1235606855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90e6389-e537-4d96-96bf-45502d087483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Creating volume b90e6389-e537-4d96-96bf-45502d087483 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:07 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:07 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 1073741824 Apr 16 11:33:07 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (8dc46548-073b-4d81-9606-afee32b4bdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb7757a-e1b4-4f89-865c-9fd2f8ad2f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb7757a-e1b4-4f89-865c-9fd2f8ad2f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13043859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96938c7-91f7-4435-8ac8-f772e821fea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a2e753-24f1-422e-b816-374e4b4ac009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a2e753-24f1-422e-b816-374e4b4ac009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7fb5b-0235-4246-a123-77b04a768929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7fb5b-0235-4246-a123-77b04a768929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96938c7-91f7-4435-8ac8-f772e821fea9', 'volume_name': 'volume-b96938c7-91f7-4435-8ac8-f772e821fea9', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ffc875-fa23-4ed2-900d-61ac7378c5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ffc875-fa23-4ed2-900d-61ac7378c5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46d8d89-5160-47ff-ab66-d5b904da8a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:07 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume b96938c7-91f7-4435-8ac8-f772e821fea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96938c7-91f7-4435-8ac8-f772e821fea9', 'volume_size': 1} Apr 16 11:33:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (3483b175-b27e-4230-9c86-84814a0904f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3a150-62fe-4ba5-aec2-7a3056bf5b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3a150-62fe-4ba5-aec2-7a3056bf5b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859974934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86dc0a2-18b2-41ae-aa0c-01e277daf551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65d4794-beb7-44a7-820c-eedbbca5ade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65d4794-beb7-44a7-820c-eedbbca5ade3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f0f02c-fea9-40df-9fff-020cc26412a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f0f02c-fea9-40df-9fff-020cc26412a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86dc0a2-18b2-41ae-aa0c-01e277daf551', 'volume_name': 'volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181adcc7-2600-44ec-8c48-221a686d2177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181adcc7-2600-44ec-8c48-221a686d2177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a24111-393d-4f69-9826-a9ada6db6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume c86dc0a2-18b2-41ae-aa0c-01e277daf551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551', 'volume_size': 1} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (9016b16c-c418-4901-b4d6-6e2dfae8a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9b7b01-2421-420d-a809-8510667c6c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9b7b01-2421-420d-a809-8510667c6c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178700495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81d6350-06ac-4cbb-b50c-968fc9feb2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44a855e-c0b3-4243-8f84-ac7833235dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44a855e-c0b3-4243-8f84-ac7833235dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90e845c-659c-4a36-a872-f585b987ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90e845c-659c-4a36-a872-f585b987ed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81d6350-06ac-4cbb-b50c-968fc9feb2ea', 'volume_name': 'volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e9a850-7a21-44e0-a69d-35cd42a9a197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e9a850-7a21-44e0-a69d-35cd42a9a197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299ed9e3-948b-4436-bbcb-abfd0c5e7f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume a81d6350-06ac-4cbb-b50c-968fc9feb2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea', 'volume_size': 1} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:08 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 1073741824" returned: 0 in 0.578s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:08 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 Apr 16 11:33:08 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (52162ac8-48dc-4513-a355-9fe288fb55a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d25c19-3b5c-4102-8a78-0520c0aad7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d25c19-3b5c-4102-8a78-0520c0aad7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625257115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31ff429-e933-4b5e-be5f-0b5cd69b7796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99034067-1b70-4025-aff7-e6c1e4801b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99034067-1b70-4025-aff7-e6c1e4801b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e07271-3902-4bb8-8eef-49c957f9c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e07271-3902-4bb8-8eef-49c957f9c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd31ff429-e933-4b5e-be5f-0b5cd69b7796', 'volume_name': 'volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2af99-1824-4704-b75f-eb96a5c92c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f2af99-1824-4704-b75f-eb96a5c92c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639cea1f-dac3-4fcb-bdcc-71098a103db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume d31ff429-e933-4b5e-be5f-0b5cd69b7796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796', 'volume_size': 1} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:08 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483" returned: 0 in 0.401s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13043859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96938c7-91f7-4435-8ac8-f772e821fea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Creating volume b96938c7-91f7-4435-8ac8-f772e821fea9 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:08 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfc4423-8554-44b8-b2be-b5c77a927491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90e6389-e537-4d96-96bf-45502d087483', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 1073741824 Apr 16 11:33:08 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a6798-39db-4d7c-9e74-6c7f1544f5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume volume-b90e6389-e537-4d96-96bf-45502d087483 (b90e6389-e537-4d96-96bf-45502d087483): created successfully Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a6798-39db-4d7c-9e74-6c7f1544f5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (262b1c8b-18cd-4180-96e2-6556f8dd973f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:08 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d7e87da1-0948-495f-a9f4-4fb8870406e0 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created volume successfully. Apr 16 11:33:09 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 1073741824" returned: 0 in 0.461s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:09 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 Apr 16 11:33:09 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:09 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9" returned: 0 in 0.404s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.563s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859974934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86dc0a2-18b2-41ae-aa0c-01e277daf551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Creating volume c86dc0a2-18b2-41ae-aa0c-01e277daf551 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:09 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46d8d89-5160-47ff-ab66-d5b904da8a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96938c7-91f7-4435-8ac8-f772e821fea9', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:09 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 1073741824 Apr 16 11:33:09 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd578f7f-f6dc-463f-8b8c-b4f6003f389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:09 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume volume-b96938c7-91f7-4435-8ac8-f772e821fea9 (b96938c7-91f7-4435-8ac8-f772e821fea9): created successfully Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd578f7f-f6dc-463f-8b8c-b4f6003f389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:09 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (8dc46548-073b-4d81-9606-afee32b4bdcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:09 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-fbe453b5-9f50-4b86-8514-70a26e6deb5d tempest-CreateVolumesFromSnapshotTest-289415383 None] Created volume successfully. Apr 16 11:33:10 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 1073741824" returned: 0 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:10 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 Apr 16 11:33:10 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:10 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551" returned: 0 in 0.402s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.257s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178700495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81d6350-06ac-4cbb-b50c-968fc9feb2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Creating volume a81d6350-06ac-4cbb-b50c-968fc9feb2ea {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:10 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a24111-393d-4f69-9826-a9ada6db6601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3410b10e-6900-4bbe-9e84-1ebbe2699087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:10 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea 1073741824 Apr 16 11:33:10 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:10 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 (c86dc0a2-18b2-41ae-aa0c-01e277daf551): created successfully Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3410b10e-6900-4bbe-9e84-1ebbe2699087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (3483b175-b27e-4230-9c86-84814a0904f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:10 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c3c6f37b-6a6b-447e-a73e-b525cd886588 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created volume successfully. Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:10 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:10 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:11 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea 1073741824" returned: 0 in 0.479s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:11 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea Apr 16 11:33:11 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:11 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.444s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:11 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea" returned: 0 in 0.410s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.016s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625257115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31ff429-e933-4b5e-be5f-0b5cd69b7796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e56916e841492f99cf580b211b7e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:08Z,use_quota=True,user_id='aec270e2e1cf42d09748a1f46faa7ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Creating volume d31ff429-e933-4b5e-be5f-0b5cd69b7796 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:11 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299ed9e3-948b-4436-bbcb-abfd0c5e7f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:11 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 1073741824 Apr 16 11:33:11 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22107ff-b77e-4333-8c67-d6ac4fd35d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:11 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea (a81d6350-06ac-4cbb-b50c-968fc9feb2ea): created successfully Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22107ff-b77e-4333-8c67-d6ac4fd35d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (9016b16c-c418-4901-b4d6-6e2dfae8a653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:11 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e80ea061-7a1d-4d09-aa8a-552930fb4485 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created volume successfully. Apr 16 11:33:12 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 1073741824" returned: 0 in 0.485s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:12 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 Apr 16 11:33:12 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:12 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796" returned: 0 in 0.395s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639cea1f-dac3-4fcb-bdcc-71098a103db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac078e8-9d32-4d05-a8e8-a30081a27a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:12 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Volume volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 (d31ff429-e933-4b5e-be5f-0b5cd69b7796): created successfully Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac078e8-9d32-4d05-a8e8-a30081a27a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Flow 'volume_create_manager' (52162ac8-48dc-4513-a355-9fe288fb55a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:12 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5b8d8c0f-281a-4672-bf68-d27fe4200a4a tempest-CreateVolumesFromSnapshotTest-289415383 None] Created volume successfully. Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-d31ff429-e933-4b5e-be5f-0b5cd69b7796-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-d31ff429-e933-4b5e-be5f-0b5cd69b7796-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-d31ff429-e933-4b5e-be5f-0b5cd69b7796" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-d31ff429-e933-4b5e-be5f-0b5cd69b7796" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b7a901-bc8c-4d3a-b3f5-5dc64afbd24b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:12 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 Apr 16 11:33:12 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:13 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796" returned: 0 in 0.450s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:13 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796 Apr 16 11:33:13 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:13 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d31ff429-e933-4b5e-be5f-0b5cd69b7796" returned: 0 in 0.390s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-d31ff429-e933-4b5e-be5f-0b5cd69b7796" released by "delete_volume" :: held 0.864s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created reservations ['2153b9d7-ed12-4a00-95e2-530276327c96', '1b69cd49-d1f3-46b8-9d9d-c0abd7e16696', '534dcdf1-8429-4fe2-accc-bc11db24efb1', 'afa90c62-8332-47c1-906d-475a059a5dd4'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:13 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:13 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-a81d6350-06ac-4cbb-b50c-968fc9feb2ea-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-a81d6350-06ac-4cbb-b50c-968fc9feb2ea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:13 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-a81d6350-06ac-4cbb-b50c-968fc9feb2ea" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-a81d6350-06ac-4cbb-b50c-968fc9feb2ea" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[226cdbfb-b668-4c8c-81ba-be1f8d726756]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:14 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea Apr 16 11:33:14 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:14 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Deleted volume successfully. Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b972718c-8e7e-4d08-b721-25dd178ea335 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-d31ff429-e933-4b5e-be5f-0b5cd69b7796-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:14 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:14 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea Apr 16 11:33:14 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:14 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a81d6350-06ac-4cbb-b50c-968fc9feb2ea" returned: 0 in 0.412s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-a81d6350-06ac-4cbb-b50c-968fc9feb2ea" released by "delete_volume" :: held 0.912s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Created reservations ['f3875ec1-b01b-4ce3-80a7-a85b2d9f2c03', 'df54ead1-153a-45d3-871f-498ed80c92ac', '0e8b5580-3d6f-4711-bdec-d4ca6f0a3b76', 'a128f9a1-8a77-42be-8a8d-c56af8e476af'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:15 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:15 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-c86dc0a2-18b2-41ae-aa0c-01e277daf551-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-c86dc0a2-18b2-41ae-aa0c-01e277daf551-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-c86dc0a2-18b2-41ae-aa0c-01e277daf551" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-c86dc0a2-18b2-41ae-aa0c-01e277daf551" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[671704c3-d994-40ba-8d85-e9011769face]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:15 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 Apr 16 11:33:15 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:15 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.428s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:15 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Deleted volume successfully. Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-bc205e7d-b625-4520-9532-df76e54af2ac tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-a81d6350-06ac-4cbb-b50c-968fc9feb2ea-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:15 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:15 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551 Apr 16 11:33:15 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:16 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-c86dc0a2-18b2-41ae-aa0c-01e277daf551" returned: 0 in 0.407s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-c86dc0a2-18b2-41ae-aa0c-01e277daf551" released by "delete_volume" :: held 0.897s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created reservations ['7e31e725-7850-4777-959e-4467ec123921', '126e11fc-cf4c-454b-b28b-600e93250a6b', '2759bfc5-e73c-4453-95d7-2b26c7283d5f', 'fc46f4a2-4409-4476-8f3a-0c0ec88800a7'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:16 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:16 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-b96938c7-91f7-4435-8ac8-f772e821fea9-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-b96938c7-91f7-4435-8ac8-f772e821fea9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-b96938c7-91f7-4435-8ac8-f772e821fea9" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-b96938c7-91f7-4435-8ac8-f772e821fea9" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cbde9-44b0-4406-b4e2-b3f2a649c755]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:16 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 Apr 16 11:33:16 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:16 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.420s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Deleted volume successfully. Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-777283f4-fac6-443b-9633-8dfb179e6508 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-c86dc0a2-18b2-41ae-aa0c-01e277daf551-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:16 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:16 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9 Apr 16 11:33:16 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:17 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b96938c7-91f7-4435-8ac8-f772e821fea9" returned: 0 in 0.398s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-b96938c7-91f7-4435-8ac8-f772e821fea9" released by "delete_volume" :: held 0.885s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Created reservations ['b2fd26cf-3c27-4db1-b80a-2d4c8bf54bf5', '9d8136b4-daef-475f-9a3f-b79d197eb2a6', 'ac4ad07d-a261-4e76-aa7d-8e15fbcd118a', 'ed76cf11-8313-4775-ad15-1c1390382544'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:17 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:17 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-b90e6389-e537-4d96-96bf-45502d087483-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-b90e6389-e537-4d96-96bf-45502d087483-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-b90e6389-e537-4d96-96bf-45502d087483" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-b90e6389-e537-4d96-96bf-45502d087483" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb8b9c-945a-418f-a62f-1596711afbcb]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:17 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 Apr 16 11:33:17 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:17 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.427s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:17 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Deleted volume successfully. Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb9be158-54d6-4c83-b307-af274685d21c tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-b96938c7-91f7-4435-8ac8-f772e821fea9-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:17 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483" returned: 0 in 0.480s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:17 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483 Apr 16 11:33:17 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:18 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-b90e6389-e537-4d96-96bf-45502d087483" returned: 0 in 0.406s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-b90e6389-e537-4d96-96bf-45502d087483" released by "delete_volume" :: held 0.905s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created reservations ['53b1bed3-3271-4710-8eaa-5b23a5a35228', 'd4fb4c3a-83ab-4d31-8a23-1b096c0a1793', '1d20fac9-5dde-4ce0-9723-4b448b440b29', '79ccc965-60f8-47fd-9bcd-de46ba80cf04'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:18 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:18 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-cbedab7d-b19e-4366-93a1-b50cf89720ac-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-cbedab7d-b19e-4366-93a1-b50cf89720ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-cbedab7d-b19e-4366-93a1-b50cf89720ac" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-cbedab7d-b19e-4366-93a1-b50cf89720ac" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Deleting offline snapshot cbedab7d-b19e-4366-93a1-b50cf89720ac of volume f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] snapshot_file for this snap is: volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c920565-bd49-4450-8e2e-04928e9f77c2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:18 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac Apr 16 11:33:18 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:18 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.416s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Deleted volume successfully. Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c681f377-d6be-4704-8c27-456fc4af8955 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-b90e6389-e537-4d96-96bf-45502d087483-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:18 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d3a6f7-1f56-4b12-a48d-34f6631c53ba]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:19 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 Apr 16 11:33:19 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:19 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" returned: 0 in 0.465s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:19 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac Apr 16 11:33:19 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:19 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:19 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac Apr 16 11:33:19 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:20 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20.cbedab7d-b19e-4366-93a1-b50cf89720ac" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-cbedab7d-b19e-4366-93a1-b50cf89720ac" released by "_delete_snapshot" :: held 1.821s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" released by "delete_snapshot" :: held 1.834s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Created reservations ['02c2b9b2-3098-431b-b61e-e32df10df89b', 'be27d4c8-2fbd-4f67-a10a-28f0bb41a406', 'a6f9e7f7-8445-43e7-8cdf-9647af102c3c', 'bacf4c14-6baa-4c18-855e-f70ee67ecc01'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Delete snapshot completed successfully. Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d1fba7ed-57e2-4a3f-bf00-390000c1ae59 tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-cbedab7d-b19e-4366-93a1-b50cf89720ac-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-f9a082cd-6f9b-463b-a014-0bb02e2f8f20-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-f9a082cd-6f9b-463b-a014-0bb02e2f8f20-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "cinder-quobyte-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f93fa75-6022-441c-97f6-a82262d9374f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:20 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 Apr 16 11:33:20 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:21 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" returned: 0 in 0.457s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:21 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20 Apr 16 11:33:21 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:21 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" returned: 0 in 0.413s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-quobyte-f9a082cd-6f9b-463b-a014-0bb02e2f8f20" released by "delete_volume" :: held 0.896s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Created reservations ['e92e19b9-6b4a-45e3-8358-fd5c78872352', '0a7893d8-71b5-4201-845f-e9d3c2bfd606', 'f8e2be87-a2ef-432c-9f95-5882234bf3c3', '6eb994ba-3164-407a-9f8e-2a638b186294'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:21 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:21 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:22 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.481s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:22 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:22 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Deleted volume successfully. Apr 16 11:33:22 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-699bb902-6cbf-482a-a5ea-fec56129462a tempest-CreateVolumesFromSnapshotTest-289415383 None] Lock "cinder-f9a082cd-6f9b-463b-a014-0bb02e2f8f20-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Flow 'volume_create_manager' (0da34e99-3ade-48e6-87da-d144a5c478ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b6f89-cf26-48dc-90d9-21a43c576555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b6f89-cf26-48dc-90d9-21a43c576555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0acf1f-e52a-4732-89ef-6e1ee15381c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479e5ff2cc364d0c8eda77985778db43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:23Z,use_quota=True,user_id='b2eb13798bd6422a917d706eada96bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fe9440-4867-4472-a9ee-f2b5c1790d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fe9440-4867-4472-a9ee-f2b5c1790d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388e9d91-6eb3-4315-9593-a515eee438bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388e9d91-6eb3-4315-9593-a515eee438bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0acf1f-e52a-4732-89ef-6e1ee15381c8', 'volume_name': 'volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf5be6e-c09d-4a4a-a316-5b5d84219780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf5be6e-c09d-4a4a-a316-5b5d84219780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b13c6-daa7-4134-9da4-51fc47c68b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:23 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Volume fa0acf1f-e52a-4732-89ef-6e1ee15381c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8', 'volume_size': 1} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0acf1f-e52a-4732-89ef-6e1ee15381c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479e5ff2cc364d0c8eda77985778db43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:23Z,use_quota=True,user_id='b2eb13798bd6422a917d706eada96bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Creating volume fa0acf1f-e52a-4732-89ef-6e1ee15381c8 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:23 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:23 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 1073741824 Apr 16 11:33:23 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:23 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 1073741824" returned: 0 in 0.466s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:23 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 Apr 16 11:33:23 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:24 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8" returned: 0 in 0.402s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b13c6-daa7-4134-9da4-51fc47c68b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa90fd5-c33a-4daf-9179-bdb712ddeb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:24 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Volume volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 (fa0acf1f-e52a-4732-89ef-6e1ee15381c8): created successfully Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa90fd5-c33a-4daf-9179-bdb712ddeb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Flow 'volume_create_manager' (0da34e99-3ade-48e6-87da-d144a5c478ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:24 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f359e824-32d4-4aaf-91a7-352ee4d00e3b tempest-CinderUnicodeTest-1987834305 None] Created volume successfully. Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Flow 'volume_create_manager' (aa93a868-a5f4-4ac2-86c6-c3f36b953d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f26ff-1cbf-414b-9525-dcc1d3e5e771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f26ff-1cbf-414b-9525-dcc1d3e5e771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1833427848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d199632a-32e3-43af-9128-2648e08d22a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479e5ff2cc364d0c8eda77985778db43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:25Z,use_quota=True,user_id='b2eb13798bd6422a917d706eada96bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cdfdee2-3ef6-4f5d-b5e4-288a9e4b233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cdfdee2-3ef6-4f5d-b5e4-288a9e4b233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1898b816-fa04-48de-98b0-71944d9e226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1898b816-fa04-48de-98b0-71944d9e226a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd199632a-32e3-43af-9128-2648e08d22a5', 'volume_name': 'volume-d199632a-32e3-43af-9128-2648e08d22a5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92672ef-a4a7-4ebe-bc30-3976f5eabd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92672ef-a4a7-4ebe-bc30-3976f5eabd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b22eba-946c-43e1-a127-d95b99c9fc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:24 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Volume d199632a-32e3-43af-9128-2648e08d22a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d199632a-32e3-43af-9128-2648e08d22a5', 'volume_size': 1} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1833427848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d199632a-32e3-43af-9128-2648e08d22a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479e5ff2cc364d0c8eda77985778db43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:25Z,use_quota=True,user_id='b2eb13798bd6422a917d706eada96bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Creating volume d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:24 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:24 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 1073741824 Apr 16 11:33:24 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:25 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 1073741824" returned: 0 in 0.466s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:25 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 Apr 16 11:33:25 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:25 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5" returned: 0 in 0.401s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b22eba-946c-43e1-a127-d95b99c9fc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d199632a-32e3-43af-9128-2648e08d22a5', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fe57c8-f321-4e24-92d5-0818320ffc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:25 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Volume volume-d199632a-32e3-43af-9128-2648e08d22a5 (d199632a-32e3-43af-9128-2648e08d22a5): created successfully Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fe57c8-f321-4e24-92d5-0818320ffc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Flow 'volume_create_manager' (aa93a868-a5f4-4ac2-86c6-c3f36b953d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:25 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-855897e3-12e5-4a2c-b199-73a2325aba96 tempest-CinderUnicodeTest-1987834305 None] Created volume successfully. Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Creating offline snapshot 328a225d-6730-4a39-b468-1fd95d1b5229 of volume d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d05899-8c39-464f-b451-e4fdbe65ab9b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:25 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 Apr 16 11:33:25 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:26 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5" returned: 0 in 0.473s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:26 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 1G Apr 16 11:33:26 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:26 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 1G" returned: 0 in 0.460s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d199632a-32e3-43af-9128-2648e08d22a5 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:26 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d199632a-32e3-43af-9128-2648e08d22a5 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 Apr 16 11:33:26 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:27 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d199632a-32e3-43af-9128-2648e08d22a5 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229" returned: 0 in 0.416s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:27 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 is being set with open permissions: ugo+rw Apr 16 11:33:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:27 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 Apr 16 11:33:27 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:27 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229" returned: 0 in 0.395s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:27 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.info Apr 16 11:33:27 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:28 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.info" returned: 0 in 0.410s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:28 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.info is being set with open permissions: ugo+rw Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:28 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.info Apr 16 11:33:28 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:28 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.info" returned: 0 in 0.412s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:28 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-be922b09-8d57-4b57-b5c7-964ea0efa4a3 tempest-CinderUnicodeTest-1987834305 None] Create snapshot completed successfully Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "cinder-328a225d-6730-4a39-b468-1fd95d1b5229-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-328a225d-6730-4a39-b468-1fd95d1b5229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "cinder-quobyte-d199632a-32e3-43af-9128-2648e08d22a5" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-d199632a-32e3-43af-9128-2648e08d22a5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "cinder-quobyte-328a225d-6730-4a39-b468-1fd95d1b5229" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-328a225d-6730-4a39-b468-1fd95d1b5229" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Deleting offline snapshot 328a225d-6730-4a39-b468-1fd95d1b5229 of volume d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] snapshot_file for this snap is: volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b37a83-044b-426f-81ca-32d675b08c5e]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:29 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 Apr 16 11:33:29 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:29 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d199632a-32e3-43af-9128-2648e08d22a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b749a780-4e1b-4850-805d-d596344bfaa2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:29 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 Apr 16 11:33:29 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:29 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5" returned: 0 in 0.453s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:29 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 Apr 16 11:33:29 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:30 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229" returned: 0 in 0.455s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:30 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229 Apr 16 11:33:30 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:30 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5.328a225d-6730-4a39-b468-1fd95d1b5229" returned: 0 in 0.393s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-328a225d-6730-4a39-b468-1fd95d1b5229" released by "_delete_snapshot" :: held 1.821s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-d199632a-32e3-43af-9128-2648e08d22a5" released by "delete_snapshot" :: held 1.833s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:30 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Created reservations ['9dab5432-e230-4ba9-a19f-e49d862496fb', 'deb8fb98-4304-4aba-bf38-77ade49cf4aa', '3c348a34-56ba-48af-a5c2-9ad848a90172', 'a40d2d3f-3535-455f-9a9f-dacf1c8455c6'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Delete snapshot completed successfully. Apr 16 11:33:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-3ff8796d-2aed-4fec-9f47-f644b426f63b tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-328a225d-6730-4a39-b468-1fd95d1b5229-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "cinder-d199632a-32e3-43af-9128-2648e08d22a5-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-d199632a-32e3-43af-9128-2648e08d22a5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "cinder-quobyte-d199632a-32e3-43af-9128-2648e08d22a5" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-d199632a-32e3-43af-9128-2648e08d22a5" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[541cd724-0374-4a1d-b5ac-3c2e45b791f2]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:31 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 Apr 16 11:33:31 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:31 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5" returned: 0 in 0.462s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:31 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5 Apr 16 11:33:31 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:32 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d199632a-32e3-43af-9128-2648e08d22a5" returned: 0 in 0.405s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-d199632a-32e3-43af-9128-2648e08d22a5" released by "delete_volume" :: held 0.895s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Created reservations ['6c9a5d46-e40d-44ec-adc2-c6bd48e00493', '4d7ca535-4c87-457d-b39a-0829d09b97ea', '68c32667-11cc-4738-81a4-35e34f29b948', 'f63c9ab1-9d90-4267-931f-a72176a29814'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:32 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:32 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "cinder-fa0acf1f-e52a-4732-89ef-6e1ee15381c8-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-fa0acf1f-e52a-4732-89ef-6e1ee15381c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "cinder-quobyte-fa0acf1f-e52a-4732-89ef-6e1ee15381c8" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-fa0acf1f-e52a-4732-89ef-6e1ee15381c8" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd21ac-1824-473f-aa9c-d8eaef3dcaef]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:32 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 Apr 16 11:33:32 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:32 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.442s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Deleted volume successfully. Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-93473095-a298-42d6-b593-1b85711fb5a6 tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-d199632a-32e3-43af-9128-2648e08d22a5-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:32 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:32 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8 Apr 16 11:33:32 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:33 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-fa0acf1f-e52a-4732-89ef-6e1ee15381c8" returned: 0 in 0.410s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-quobyte-fa0acf1f-e52a-4732-89ef-6e1ee15381c8" released by "delete_volume" :: held 0.906s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Created reservations ['999b0273-5812-441b-a8bc-1251ac34540e', '37b3ff62-7851-499b-947f-def9650ddde7', '27057d34-a061-4fdc-8e95-5c53c4842594', 'f30f66db-5070-40ce-a78a-2c0480106d87'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:33 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:33 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:33 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.470s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:33 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Deleted volume successfully. Apr 16 11:33:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-45b48c4d-9044-4026-bb5b-4c06852d123d tempest-CinderUnicodeTest-1987834305 None] Lock "cinder-fa0acf1f-e52a-4732-89ef-6e1ee15381c8-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (65d5b348-6dee-4990-92e3-3a1ceb749d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151fe8c1-e822-4551-98ad-471091e21692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151fe8c1-e822-4551-98ad-471091e21692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914556925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6aa929-3462-4217-b525-2f1e105af720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:40Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd7e48f-a208-4d92-9ab5-65eb0415774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd7e48f-a208-4d92-9ab5-65eb0415774e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71cc0b2-c3c9-451e-8cc1-0432157392e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71cc0b2-c3c9-451e-8cc1-0432157392e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6aa929-3462-4217-b525-2f1e105af720', 'volume_name': 'volume-9e6aa929-3462-4217-b525-2f1e105af720', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5935b39e-d361-45fb-b9bd-a746a973a979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5935b39e-d361-45fb-b9bd-a746a973a979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f007c6-1558-4915-a4eb-33c8bac4be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Volume 9e6aa929-3462-4217-b525-2f1e105af720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6aa929-3462-4217-b525-2f1e105af720', 'volume_size': 1} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914556925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6aa929-3462-4217-b525-2f1e105af720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:40Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Creating volume 9e6aa929-3462-4217-b525-2f1e105af720 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:40 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (4c4b6085-5530-4841-9bc3-d8abfae46908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc5c1bc-33e1-441e-a788-d1d73acca522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 1073741824 Apr 16 11:33:40 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc5c1bc-33e1-441e-a788-d1d73acca522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1900586359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3064a05-d54e-48f4-b096-c11cb9023034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a13b7eb97e441480e06b35829b5146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:40Z,use_quota=True,user_id='3abfa09ce1444f318f2d0be662bc4c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09be760-ee61-4f90-9810-2dd26e87da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09be760-ee61-4f90-9810-2dd26e87da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9934e4bb-1aeb-4da2-aa8d-bb45bbada05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9934e4bb-1aeb-4da2-aa8d-bb45bbada05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3064a05-d54e-48f4-b096-c11cb9023034', 'volume_name': 'volume-f3064a05-d54e-48f4-b096-c11cb9023034', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f02533-f838-4d6f-b134-986ec0f87d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f02533-f838-4d6f-b134-986ec0f87d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a649de1a-7a01-4e65-a634-e84e2fdd9a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Volume f3064a05-d54e-48f4-b096-c11cb9023034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3064a05-d54e-48f4-b096-c11cb9023034', 'volume_size': 1} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (66dd51c3-14c5-4305-b4fc-bc805517fb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbb842a-a42e-46c6-9c1a-4f4656c8339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbb842a-a42e-46c6-9c1a-4f4656c8339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821529922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f461bf5b-5a44-4f48-aa82-d34b9c34cd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930db63a-fb24-48a1-a089-5c2ba064b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930db63a-fb24-48a1-a089-5c2ba064b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0133e91f-b7b8-4de8-ab64-715fa066ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0133e91f-b7b8-4de8-ab64-715fa066ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f461bf5b-5a44-4f48-aa82-d34b9c34cd69', 'volume_name': 'volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b389a1-e3c5-4a63-b4ed-0aaf474e031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b389a1-e3c5-4a63-b4ed-0aaf474e031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82fe0b6-49a2-4439-927b-9bd4f4375279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume f461bf5b-5a44-4f48-aa82-d34b9c34cd69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69', 'volume_size': 1} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (63f60618-70c5-47f1-8eee-7b5fbe101598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e991d4-ed58-4310-8235-c5248282f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e991d4-ed58-4310-8235-c5248282f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1793943687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be7d745-04c7-4b90-b770-940ffa62625a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b23e8f3-44fe-4c8f-91bb-1fc994f8122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b23e8f3-44fe-4c8f-91bb-1fc994f8122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b3127-6eb6-4034-93ae-b8fd387d2cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b3127-6eb6-4034-93ae-b8fd387d2cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be7d745-04c7-4b90-b770-940ffa62625a', 'volume_name': 'volume-1be7d745-04c7-4b90-b770-940ffa62625a', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467641d4-7f04-43ee-abce-7f4056e23e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467641d4-7f04-43ee-abce-7f4056e23e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f552c2a7-6247-4e91-bc64-d009d986d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Volume 1be7d745-04c7-4b90-b770-940ffa62625a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be7d745-04c7-4b90-b770-940ffa62625a', 'volume_size': 1} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (cab0f849-0bba-47af-a3ce-491c041e33e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebdf347-7994-40c1-a353-10f383311cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebdf347-7994-40c1-a353-10f383311cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365684055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c78b6ba-fbfa-4ff6-bf84-91c1a779a279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65ef4cc-1c09-42de-8d6d-cd801887db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65ef4cc-1c09-42de-8d6d-cd801887db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3372c77e-29f9-4cf4-adba-6da1e1096ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3372c77e-29f9-4cf4-adba-6da1e1096ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c78b6ba-fbfa-4ff6-bf84-91c1a779a279', 'volume_name': 'volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b9bacb-7564-4fe4-833f-95ba2e81b4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b9bacb-7564-4fe4-833f-95ba2e81b4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd868f0-0352-44b3-b26e-7fd692915052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:40 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Volume 4c78b6ba-fbfa-4ff6-bf84-91c1a779a279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279', 'volume_size': 1} Apr 16 11:33:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:41 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 1073741824" returned: 0 in 0.763s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (c6759fe5-2993-49ba-9556-85bbe495aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c60bfd-4963-4c18-85cd-12264752f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c60bfd-4963-4c18-85cd-12264752f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717704755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80b4e3f-e700-40ca-87c5-d153121e3afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc146b68-0816-45c6-90ae-0bfde8496f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc146b68-0816-45c6-90ae-0bfde8496f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95b2c04-9787-4b95-9e00-fe4798029805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95b2c04-9787-4b95-9e00-fe4798029805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80b4e3f-e700-40ca-87c5-d153121e3afe', 'volume_name': 'volume-a80b4e3f-e700-40ca-87c5-d153121e3afe', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08acdf35-e35c-4df3-832a-ac07447a101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08acdf35-e35c-4df3-832a-ac07447a101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7dd19e-6767-4e7d-8d01-b39a8311d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Volume a80b4e3f-e700-40ca-87c5-d153121e3afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80b4e3f-e700-40ca-87c5-d153121e3afe', 'volume_size': 1} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:41 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 Apr 16 11:33:41 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (89a3e11c-e05b-420a-8f0f-fe52ac77fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59de4af-a086-43af-b193-8198a74f0362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59de4af-a086-43af-b193-8198a74f0362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-887185547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96aca11-a5a0-4e3f-80b8-047f2705a047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b3916d-3fbf-4a5e-89c6-bda142706b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b3916d-3fbf-4a5e-89c6-bda142706b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9991ca9e-d916-4484-b53b-bc869752ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9991ca9e-d916-4484-b53b-bc869752ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96aca11-a5a0-4e3f-80b8-047f2705a047', 'volume_name': 'volume-f96aca11-a5a0-4e3f-80b8-047f2705a047', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdc56d0-571c-42d8-bbd2-dfd928b9ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdc56d0-571c-42d8-bbd2-dfd928b9ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fd4377-cd97-4c48-bbd5-90bb45dd3d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Volume f96aca11-a5a0-4e3f-80b8-047f2705a047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96aca11-a5a0-4e3f-80b8-047f2705a047', 'volume_size': 1} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:41 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720" returned: 0 in 0.520s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1900586359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3064a05-d54e-48f4-b096-c11cb9023034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a13b7eb97e441480e06b35829b5146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:40Z,use_quota=True,user_id='3abfa09ce1444f318f2d0be662bc4c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Creating volume f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:41 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f007c6-1558-4915-a4eb-33c8bac4be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6aa929-3462-4217-b525-2f1e105af720', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 1073741824 Apr 16 11:33:41 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdce38e-7bf8-497a-9153-f3e826cb09ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:41 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Volume volume-9e6aa929-3462-4217-b525-2f1e105af720 (9e6aa929-3462-4217-b525-2f1e105af720): created successfully Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdce38e-7bf8-497a-9153-f3e826cb09ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:41 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (65d5b348-6dee-4990-92e3-3a1ceb749d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:41 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-696216dd-633e-4021-9046-70a75a3a64f2 tempest-CreateVolumesFromImageTest-36792385 None] Created volume successfully. Apr 16 11:33:42 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 1073741824" returned: 0 in 0.492s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:42 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 Apr 16 11:33:42 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:42 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034" returned: 0 in 0.473s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821529922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f461bf5b-5a44-4f48-aa82-d34b9c34cd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Creating volume f461bf5b-5a44-4f48-aa82-d34b9c34cd69 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:42 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a649de1a-7a01-4e65-a634-e84e2fdd9a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3064a05-d54e-48f4-b096-c11cb9023034', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:42 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 1073741824 Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b0cc98-f2f2-4781-921d-4e3459b25f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:42 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:42 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Volume volume-f3064a05-d54e-48f4-b096-c11cb9023034 (f3064a05-d54e-48f4-b096-c11cb9023034): created successfully Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b0cc98-f2f2-4781-921d-4e3459b25f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:42 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (4c4b6085-5530-4841-9bc3-d8abfae46908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:42 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5fe148ea-fa7e-423b-a333-c7f48001b424 tempest-VolumeDependencyTests-316086749 None] Created volume successfully. Apr 16 11:33:43 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 1073741824" returned: 0 in 0.480s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:43 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 Apr 16 11:33:43 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:43 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69" returned: 0 in 0.521s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1793943687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be7d745-04c7-4b90-b770-940ffa62625a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Creating volume 1be7d745-04c7-4b90-b770-940ffa62625a {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:43 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82fe0b6-49a2-4439-927b-9bd4f4375279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a4dc75-7ca9-486f-bb34-182e09122e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:43 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 (f461bf5b-5a44-4f48-aa82-d34b9c34cd69): created successfully Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a4dc75-7ca9-486f-bb34-182e09122e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:43 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a 1073741824 Apr 16 11:33:43 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (66dd51c3-14c5-4305-b4fc-bc805517fb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:43 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:43 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d173b776-8b52-409b-b552-eb870faadf8e tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created volume successfully. Apr 16 11:33:44 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a 1073741824" returned: 0 in 0.539s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:44 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a Apr 16 11:33:44 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:44 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a" returned: 0 in 0.459s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.856s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365684055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c78b6ba-fbfa-4ff6-bf84-91c1a779a279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Creating volume 4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:44 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f552c2a7-6247-4e91-bc64-d009d986d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be7d745-04c7-4b90-b770-940ffa62625a', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:44 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 1073741824 Apr 16 11:33:44 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad37d07-e837-4b42-90b9-f3b60da898a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:44 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Volume volume-1be7d745-04c7-4b90-b770-940ffa62625a (1be7d745-04c7-4b90-b770-940ffa62625a): created successfully Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad37d07-e837-4b42-90b9-f3b60da898a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:44 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (63f60618-70c5-47f1-8eee-7b5fbe101598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:44 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-bc488dcf-65ce-4028-9451-c902353dd59f tempest-CreateVolumesFromImageTest-36792385 None] Created volume successfully. Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (a31f8565-d7bb-4b04-8cf1-15417b74a290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a0446c-5839-44e1-8537-71a4aad428fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a0446c-5839-44e1-8537-71a4aad428fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556049151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29e00ec-56b4-4214-9bfa-ca27f22f7348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:45Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6173a102-47b8-4d5d-8792-734c5a7934ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6173a102-47b8-4d5d-8792-734c5a7934ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0f53a6-a85d-43bc-9c87-4147d5189147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0f53a6-a85d-43bc-9c87-4147d5189147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29e00ec-56b4-4214-9bfa-ca27f22f7348', 'volume_name': 'volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846a468e-ea21-40a7-ac88-96c90fa99d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846a468e-ea21-40a7-ac88-96c90fa99d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ec74ae-b3f7-4b6c-9380-7b46971a665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume a29e00ec-56b4-4214-9bfa-ca27f22f7348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348', 'volume_size': 1} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:45 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (dc915cd5-b51e-442c-9eee-96a8e844a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d882f0-962a-4fa0-ad66-db3ec0bdcd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 1073741824" returned: 0 in 0.605s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d882f0-962a-4fa0-ad66-db3ec0bdcd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194093217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31761e51-665f-44e9-ac99-d507fd22f012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:45Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3489f4a-540e-4c88-add3-cb36dbbba59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3489f4a-540e-4c88-add3-cb36dbbba59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95251f7b-145c-4b7d-bb5a-ead8ca32423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95251f7b-145c-4b7d-bb5a-ead8ca32423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31761e51-665f-44e9-ac99-d507fd22f012', 'volume_name': 'volume-31761e51-665f-44e9-ac99-d507fd22f012', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3839bc0d-4c3f-462e-a800-ce790feb88cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3839bc0d-4c3f-462e-a800-ce790feb88cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181ebdff-1a19-4b24-b15d-1674543e115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume 31761e51-665f-44e9-ac99-d507fd22f012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31761e51-665f-44e9-ac99-d507fd22f012', 'volume_size': 1} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:45 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 Apr 16 11:33:45 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (4e18f48b-c0b8-48af-9ed6-ed41eaf0b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebc6ef1-411d-400c-a722-a671bfa735e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebc6ef1-411d-400c-a722-a671bfa735e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-571046192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c87a493-92fc-4e91-831e-2f83d3552d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:46Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20dd0bb-658b-4358-a2f6-b72c1b85f560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20dd0bb-658b-4358-a2f6-b72c1b85f560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf663472-5b1e-427c-afdf-f34f58887ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf663472-5b1e-427c-afdf-f34f58887ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c87a493-92fc-4e91-831e-2f83d3552d9d', 'volume_name': 'volume-7c87a493-92fc-4e91-831e-2f83d3552d9d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18413897-ee22-400f-8dfd-ff12c16d493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18413897-ee22-400f-8dfd-ff12c16d493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92db45a-1bb1-4a20-b728-88d8e883da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume 7c87a493-92fc-4e91-831e-2f83d3552d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c87a493-92fc-4e91-831e-2f83d3552d9d', 'volume_size': 1} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (65db9a1b-6a8a-4ef1-ae8d-b55ea7876c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63e4315-c171-4f27-aeb8-a8da782c6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63e4315-c171-4f27-aeb8-a8da782c6acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053905264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:46Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fddf626-1ee2-4f5c-a521-f853946d3024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fddf626-1ee2-4f5c-a521-f853946d3024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2743977c-26fa-4615-9e8d-9c1d178e61f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2743977c-26fa-4615-9e8d-9c1d178e61f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82', 'volume_name': 'volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c57d4d0-7e5a-4e11-b821-2b060cd0e6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c57d4d0-7e5a-4e11-b821-2b060cd0e6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a37cf4a-2f2d-4cb8-ac99-baa1c7fda136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:45 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume 3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82', 'volume_size': 1} Apr 16 11:33:45 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (71e23e26-c537-46f7-8b80-0b3ebf73c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f402aaa-418c-4ff8-96fa-40a409984919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f402aaa-418c-4ff8-96fa-40a409984919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862156266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2e674b-5cfd-4fac-b835-0b28c76a8a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:46Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9793774c-6b2b-49f9-9fc3-d67ab328b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9793774c-6b2b-49f9-9fc3-d67ab328b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:46 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7467d927-e3cc-4667-97be-bc6c3d083a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7467d927-e3cc-4667-97be-bc6c3d083a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2e674b-5cfd-4fac-b835-0b28c76a8a2b', 'volume_name': 'volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1b982-98cf-4010-a1c2-1d7f82488499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1b982-98cf-4010-a1c2-1d7f82488499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfa6480-1d70-4c33-9bed-4899b5b3a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:46 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume 6b2e674b-5cfd-4fac-b835-0b28c76a8a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b', 'volume_size': 1} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279" returned: 0 in 0.710s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.975s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717704755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80b4e3f-e700-40ca-87c5-d153121e3afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Creating volume a80b4e3f-e700-40ca-87c5-d153121e3afe {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:46 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:46 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe 1073741824 Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd868f0-0352-44b3-b26e-7fd692915052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:46 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e7bc3-9074-460b-8f58-8d864a8e8016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:46 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Volume volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 (4c78b6ba-fbfa-4ff6-bf84-91c1a779a279): created successfully Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e7bc3-9074-460b-8f58-8d864a8e8016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (cab0f849-0bba-47af-a3ce-491c041e33e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:46 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8abee3a5-9cc4-499b-a734-bbc9fe27ee1c tempest-CreateVolumesFromImageTest-36792385 None] Created volume successfully. Apr 16 11:33:46 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe 1073741824" returned: 0 in 0.610s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:46 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:46 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe Apr 16 11:33:46 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:47 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.872s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-887185547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96aca11-a5a0-4e3f-80b8-047f2705a047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96604808727424fa3eb0067a03a96af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:41Z,use_quota=True,user_id='015a6468f7f843dd84532fe6316f9d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Creating volume f96aca11-a5a0-4e3f-80b8-047f2705a047 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:47 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7dd19e-6767-4e7d-8d01-b39a8311d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80b4e3f-e700-40ca-87c5-d153121e3afe', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cb27ac-9d19-4a1b-9599-a05c2d414617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:47 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 1073741824 Apr 16 11:33:47 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:47 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Volume volume-a80b4e3f-e700-40ca-87c5-d153121e3afe (a80b4e3f-e700-40ca-87c5-d153121e3afe): created successfully Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cb27ac-9d19-4a1b-9599-a05c2d414617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (c6759fe5-2993-49ba-9556-85bbe495aba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:47 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-dd0e7fcd-bc02-4658-b3d6-5dd700daec6c tempest-CreateVolumesFromImageTest-36792385 None] Created volume successfully. Apr 16 11:33:47 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 1073741824" returned: 0 in 0.517s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:47 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:47 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 Apr 16 11:33:47 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:48 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047" returned: 0 in 0.452s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.753s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Creating offline snapshot 3fda9e26-aad9-4ebc-b211-9971e54f91fa of volume f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fd4377-cd97-4c48-bbd5-90bb45dd3d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96aca11-a5a0-4e3f-80b8-047f2705a047', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c606192-8202-46ea-8ec5-bab186a1d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9955e47-becc-4459-9266-bd0228402841]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:48 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Volume volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 (f96aca11-a5a0-4e3f-80b8-047f2705a047): created successfully Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c606192-8202-46ea-8ec5-bab186a1d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Flow 'volume_create_manager' (89a3e11c-e05b-420a-8f0f-fe52ac77fef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:48 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ab356d32-b6f1-4a91-aecd-60f616dc5a70 tempest-CreateVolumesFromImageTest-36792385 None] Created volume successfully. Apr 16 11:33:48 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 Apr 16 11:33:48 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:48 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034" returned: 0 in 0.582s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:48 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:48 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa 1G Apr 16 11:33:48 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-f96aca11-a5a0-4e3f-80b8-047f2705a047-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-f96aca11-a5a0-4e3f-80b8-047f2705a047-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-quobyte-f96aca11-a5a0-4e3f-80b8-047f2705a047" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-f96aca11-a5a0-4e3f-80b8-047f2705a047" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb15da58-e35f-4892-af8a-c3aa3fb7a81c]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:49 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 Apr 16 11:33:49 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:49 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa 1G" returned: 0 in 0.543s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3064a05-d54e-48f4-b096-c11cb9023034 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:49 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3064a05-d54e-48f4-b096-c11cb9023034 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa Apr 16 11:33:49 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:49 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047" returned: 0 in 0.572s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:49 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:49 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047 Apr 16 11:33:49 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:50 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3064a05-d54e-48f4-b096-c11cb9023034 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa" returned: 0 in 0.519s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:50 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa is being set with open permissions: ugo+rw Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:50 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa Apr 16 11:33:50 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:50 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f96aca11-a5a0-4e3f-80b8-047f2705a047" returned: 0 in 0.443s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-f96aca11-a5a0-4e3f-80b8-047f2705a047" released by "delete_volume" :: held 1.042s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Created reservations ['d2832c28-cc26-4f9f-a288-d806d0db0148', '34768231-8a7b-49b8-be35-a689a3c3999a', '4e646ee2-8288-48c9-aad4-585a98feb24f', 'b85f0c4e-2026-4c29-a38a-6cafb9548518'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:50 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:50 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:50 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa" returned: 0 in 0.472s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:50 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.info Apr 16 11:33:50 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:50 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.416s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:50 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Deleted volume successfully. Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-619fc563-4af5-4542-965f-573b0051d769 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-f96aca11-a5a0-4e3f-80b8-047f2705a047-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:50 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.info" returned: 0 in 0.461s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:50 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.info is being set with open permissions: ugo+rw Apr 16 11:33:50 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:50 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.info Apr 16 11:33:50 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-a80b4e3f-e700-40ca-87c5-d153121e3afe-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-a80b4e3f-e700-40ca-87c5-d153121e3afe-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-quobyte-a80b4e3f-e700-40ca-87c5-d153121e3afe" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-a80b4e3f-e700-40ca-87c5-d153121e3afe" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4d85e4-123e-42d3-b516-bb7e77d7a0b4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:51 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe Apr 16 11:33:51 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:51 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.info" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.271s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556049151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29e00ec-56b4-4214-9bfa-ca27f22f7348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:45Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Creating volume a29e00ec-56b4-4214-9bfa-ca27f22f7348 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:51 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:51 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-7e3cdc34-0d4d-4793-9676-10601c36a588 tempest-VolumeDependencyTests-316086749 None] Create snapshot completed successfully Apr 16 11:33:51 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 1073741824 Apr 16 11:33:51 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:51 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe" returned: 0 in 0.599s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:51 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:51 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe Apr 16 11:33:51 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:52 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 1073741824" returned: 0 in 0.577s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:52 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 Apr 16 11:33:52 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (c4c23e93-15d4-4821-956d-b57da8e1affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551f4306-e4cc-4048-9929-b582bbe9f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551f4306-e4cc-4048-9929-b582bbe9f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1463020563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a117cbef-c390-4bd5-b33d-dfb499334009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a13b7eb97e441480e06b35829b5146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fda9e26-aad9-4ebc-b211-9971e54f91fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:52Z,use_quota=True,user_id='3abfa09ce1444f318f2d0be662bc4c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2b342e-4010-4580-9e45-ad7f3bd2e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2b342e-4010-4580-9e45-ad7f3bd2e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603c6301-762e-4b47-883c-0509a845b863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603c6301-762e-4b47-883c-0509a845b863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a117cbef-c390-4bd5-b33d-dfb499334009', 'volume_name': 'volume-a117cbef-c390-4bd5-b33d-dfb499334009', 'volume_size': 1, 'snapshot_id': '3fda9e26-aad9-4ebc-b211-9971e54f91fa'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523e9c74-bdbd-4ef1-8c23-d568fa15a6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523e9c74-bdbd-4ef1-8c23-d568fa15a6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2580b7d-0bdc-46c1-87a1-26c9f097efff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Volume a117cbef-c390-4bd5-b33d-dfb499334009: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a117cbef-c390-4bd5-b33d-dfb499334009', 'volume_size': 1, 'snapshot_id': '3fda9e26-aad9-4ebc-b211-9971e54f91fa'} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:52 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a80b4e3f-e700-40ca-87c5-d153121e3afe" returned: 0 in 0.567s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-a80b4e3f-e700-40ca-87c5-d153121e3afe" released by "delete_volume" :: held 1.192s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Created reservations ['80b66b80-2523-445a-b0e5-1a76b7566983', 'c98f1a44-4cd5-4f28-b5e2-ba98333c2e07', '4fe3f1c2-dde2-407f-9fd5-c208da735213', '5cbefe13-83b5-4315-ab01-069eaa116e7d'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:52 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.083s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194093217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31761e51-665f-44e9-ac99-d507fd22f012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:45Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Creating volume 31761e51-665f-44e9-ac99-d507fd22f012 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:52 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:52 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 1073741824 Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ec74ae-b3f7-4b6c-9380-7b46971a665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:52 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fc4710-614a-48ad-a524-ccdfba317592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:52 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 (a29e00ec-56b4-4214-9bfa-ca27f22f7348): created successfully Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fc4710-614a-48ad-a524-ccdfba317592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (a31f8565-d7bb-4b04-8cf1-15417b74a290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:52 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:52 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-91183f7b-aab7-4343-9bef-b5c19e9c8b24 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created volume successfully. Apr 16 11:33:52 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:52 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:53 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 1073741824" returned: 0 in 0.514s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:53 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.491s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Deleted volume successfully. Apr 16 11:33:53 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 Apr 16 11:33:53 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b65be1e1-dfc2-4459-a8d2-1c8af6fa7233 tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-a80b4e3f-e700-40ca-87c5-d153121e3afe-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-quobyte-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f3f7d-38a0-4cf3-b9af-6b6ab420c057]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:53 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 Apr 16 11:33:53 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:53 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012" returned: 0 in 0.535s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-571046192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c87a493-92fc-4e91-831e-2f83d3552d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:46Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Creating volume 7c87a493-92fc-4e91-831e-2f83d3552d9d {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:53 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181ebdff-1a19-4b24-b15d-1674543e115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31761e51-665f-44e9-ac99-d507fd22f012', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d66be5-071e-4773-bbde-fd33462a47cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:53 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume volume-31761e51-665f-44e9-ac99-d507fd22f012 (31761e51-665f-44e9-ac99-d507fd22f012): created successfully Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d66be5-071e-4773-bbde-fd33462a47cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:53 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d 1073741824 Apr 16 11:33:53 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (dc915cd5-b51e-442c-9eee-96a8e844a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:53 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:53 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e8f83eb3-fc98-4382-b052-e3fe93ec1b73 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created volume successfully. Apr 16 11:33:54 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279" returned: 0 in 0.533s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:54 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279 Apr 16 11:33:54 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:54 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d 1073741824" returned: 0 in 0.655s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:54 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d Apr 16 11:33:54 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:54 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279" returned: 0 in 0.530s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279" released by "delete_volume" :: held 1.094s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Created reservations ['9a744de6-3b14-48eb-b364-1b5fb6d8ea44', '1d857223-078b-494c-974f-b319ac4d25fc', '0fdb60c4-e46c-460c-936f-d64bfe49411e', '6ef2cc55-5bd1-46f5-ade2-a3ebc70c5fa6'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:54 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:54 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:54 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.874s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053905264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:46Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Creating volume 3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:54 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92db45a-1bb1-4a20-b728-88d8e883da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c87a493-92fc-4e91-831e-2f83d3552d9d', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f30a04a-6d0e-4839-8dce-69818c65bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:54 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume volume-7c87a493-92fc-4e91-831e-2f83d3552d9d (7c87a493-92fc-4e91-831e-2f83d3552d9d): created successfully Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f30a04a-6d0e-4839-8dce-69818c65bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:54 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 1073741824 Apr 16 11:33:54 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (4e18f48b-c0b8-48af-9ed6-ed41eaf0b24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:54 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:54 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d865cc7a-585c-4ed1-b63e-92d1093c13c0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created volume successfully. Apr 16 11:33:55 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.474s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:55 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Deleted volume successfully. Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-ff982255-bbb8-44ce-9753-c6a2b3aff66c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-4c78b6ba-fbfa-4ff6-bf84-91c1a779a279-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:55 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 1073741824" returned: 0 in 0.627s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:55 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 Apr 16 11:33:55 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-1be7d745-04c7-4b90-b770-940ffa62625a-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-1be7d745-04c7-4b90-b770-940ffa62625a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-quobyte-1be7d745-04c7-4b90-b770-940ffa62625a" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-1be7d745-04c7-4b90-b770-940ffa62625a" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[230aea39-b58f-4068-a707-49a7d1f7a649]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:55 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:55 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a Apr 16 11:33:55 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:56 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82" returned: 0 in 0.588s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.821s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862156266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2e674b-5cfd-4fac-b835-0b28c76a8a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec0fa2f7fdb441686dfa6d59c37b590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:46Z,use_quota=True,user_id='c830b6eff10540bfa2f7812b5ae097ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Creating volume 6b2e674b-5cfd-4fac-b835-0b28c76a8a2b {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:56 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a37cf4a-2f2d-4cb8-ac99-baa1c7fda136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd4d126-3fe2-478f-aa54-f6bcd594d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:56 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 (3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82): created successfully Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd4d126-3fe2-478f-aa54-f6bcd594d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (65db9a1b-6a8a-4ef1-ae8d-b55ea7876c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:56 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b 1073741824 Apr 16 11:33:56 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:56 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-19c156dc-dd3b-49e3-b49a-893cc9cdd1d0 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created volume successfully. Apr 16 11:33:56 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a" returned: 0 in 0.761s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:56 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a Apr 16 11:33:56 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:56 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b 1073741824" returned: 0 in 0.610s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:56 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:56 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b Apr 16 11:33:56 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:57 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-1be7d745-04c7-4b90-b770-940ffa62625a" returned: 0 in 0.539s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-1be7d745-04c7-4b90-b770-940ffa62625a" released by "delete_volume" :: held 1.328s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Created reservations ['61622a6f-5f2b-45a8-811c-695b9cb4d56c', 'cfd537e5-b1d4-470e-bfa6-5a2ca87751c1', '5065d317-19d5-4c1f-b2e9-9c397c8e26e9', 'a5a05cbc-55f4-413f-a292-525a3678065b'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:57 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:57 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:57 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b" returned: 0 in 0.493s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.903s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-3fda9e26-aad9-4ebc-b211-9971e54f91fa-a117cbef-c390-4bd5-b33d-dfb499334009" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfa6480-1d70-4c33-9bed-4899b5b3a099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3617ca-d405-486c-a1f5-168dcf1467b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Flow 'volume_create_manager' (3497d268-1b36-4a00-a673-1af1831fce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703b5f31-621c-47ec-a0d7-104bf6869b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:57 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Volume volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b (6b2e674b-5cfd-4fac-b835-0b28c76a8a2b): created successfully Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3617ca-d405-486c-a1f5-168dcf1467b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Flow 'volume_create_manager' (71e23e26-c537-46f7-8b80-0b3ebf73c755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-3fda9e26-aad9-4ebc-b211-9971e54f91fa-a117cbef-c390-4bd5-b33d-dfb499334009" acquired by "_create_volume_from_snapshot" :: waited 0.081s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Creating volume a117cbef-c390-4bd5-b33d-dfb499334009 from snapshot 3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-a117cbef-c390-4bd5-b33d-dfb499334009" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703b5f31-621c-47ec-a0d7-104bf6869b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1900070724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cb39ee-b602-40a0-8049-9e93c122c0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b2d4b731394dd3a2ec873da6d1bfa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:57Z,use_quota=True,user_id='d2a61dc5eecd41bfa554e9442867b3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3d178e-ae91-48ef-a3d6-95be0d436bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3d178e-ae91-48ef-a3d6-95be0d436bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0c2687-0068-4f51-b71f-3ee91c7aac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0c2687-0068-4f51-b71f-3ee91c7aac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cb39ee-b602-40a0-8049-9e93c122c0c4', 'volume_name': 'volume-13cb39ee-b602-40a0-8049-9e93c122c0c4', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a3e115-3556-4961-99c7-672df343204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a3e115-3556-4961-99c7-672df343204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530ef80-45c5-424e-9c9f-bb11213ae953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:33:57 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Volume 13cb39ee-b602-40a0-8049-9e93c122c0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cb39ee-b602-40a0-8049-9e93c122c0c4', 'volume_size': 1} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-cae99275-a5a7-4092-9385-5f2664a09bb4 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created volume successfully. Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-a117cbef-c390-4bd5-b33d-dfb499334009" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] snapshot: 3fda9e26-aad9-4ebc-b211-9971e54f91fa, volume: a117cbef-c390-4bd5-b33d-dfb499334009, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a308dd6-4d43-4810-b886-1a92cbbf2671]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:57 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa Apr 16 11:33:57 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:57 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.427s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:33:57 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Deleted volume successfully. Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-31aa4bdd-2d0f-4d4d-9054-71b9071da39c tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-1be7d745-04c7-4b90-b770-940ffa62625a-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:57 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa" returned: 0 in 0.499s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3064a05-d54e-48f4-b096-c11cb9023034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[26573551-2c10-49a6-b3d6-63cf34d94f50]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-9e6aa929-3462-4217-b525-2f1e105af720-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-9e6aa929-3462-4217-b525-2f1e105af720-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "cinder-quobyte-9e6aa929-3462-4217-b525-2f1e105af720" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-9e6aa929-3462-4217-b525-2f1e105af720" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:57 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38b1aa5-fed0-4859-9ea6-5e34cc7e538a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:57 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:57 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:58 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 Apr 16 11:33:58 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-quobyte-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c7d2a-e20e-4ff9-966a-edc8dd27d2a7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:58 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b Apr 16 11:33:58 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:58 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034" returned: 0 in 0.505s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:58 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 Apr 16 11:33:58 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:58 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720" returned: 0 in 0.517s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:58 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720 Apr 16 11:33:58 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:58 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b" returned: 0 in 0.509s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:58 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b Apr 16 11:33:58 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:58 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9e6aa929-3462-4217-b525-2f1e105af720" returned: 0 in 0.443s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-quobyte-9e6aa929-3462-4217-b525-2f1e105af720" released by "delete_volume" :: held 0.984s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:58 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Created reservations ['5c443d8e-86f4-4dfe-b166-0277c535d9b1', 'b9e1b053-fa6e-4625-9e09-e341af16f3f5', '592937ae-2e35-4593-8fc3-21692cccf4a3', 'bea69d41-b0e5-4f89-86bd-c745dd16d7eb'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:33:59 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:33:59 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:33:59 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b" returned: 0 in 1.116s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b" released by "delete_volume" :: held 1.659s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:33:59 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created reservations ['ebe6604a-2eb9-4613-ac1c-40b1b36f232b', '738d8927-0b5b-4f82-8070-704c7c491bc9', 'd8f8953c-94d2-48b9-b589-31f1be8218b0', '67524422-dbe7-4f19-8f0f-f66f18aace83'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:00 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:00 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-quobyte-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[95329f68-efb1-413b-a98e-ef24829d7096]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:00 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009" returned: 0 in 2.244s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed56aaf-25a1-4385-a589-3b909114156f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:00 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 1.550s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:00 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 Apr 16 11:34:00 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Deleted volume successfully. Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-1e6d1e73-526e-4405-9bb4-12a41a0ded5b tempest-CreateVolumesFromImageTest-36792385 None] Lock "cinder-9e6aa929-3462-4217-b525-2f1e105af720-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:00 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 Apr 16 11:34:00 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:00 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.699s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:00 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Deleted volume successfully. Apr 16 11:34:00 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-d32d45be-c926-49b1-ab81-81df48c21c4b tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-6b2e674b-5cfd-4fac-b835-0b28c76a8a2b-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:01 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82" returned: 0 in 0.598s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:01 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82 Apr 16 11:34:01 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:01 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034" returned: 0 in 0.730s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:34:01 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Converted 1024.00 MB image at 456.10 MB/s Apr 16 11:34:01 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 is being set with open permissions: ugo+rw Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:01 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 Apr 16 11:34:01 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:01 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82" returned: 0 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82" released by "delete_volume" :: held 1.098s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created reservations ['6136fd50-276e-49ad-a884-ad2841a6a5b8', '8add915c-e90d-4268-a1a8-21ed96a544b3', '6ef643a0-8c47-412e-80cb-7ef017c755b4', 'a1d5d03a-f527-4763-9282-02e0fca801b7'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:01 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:01 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:01 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009" returned: 0 in 0.512s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-a117cbef-c390-4bd5-b33d-dfb499334009" released by "_copy_volume_from_snapshot" :: held 4.544s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-3fda9e26-aad9-4ebc-b211-9971e54f91fa-a117cbef-c390-4bd5-b33d-dfb499334009" released by "_create_volume_from_snapshot" :: held 4.606s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.688s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1900070724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cb39ee-b602-40a0-8049-9e93c122c0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b2d4b731394dd3a2ec873da6d1bfa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:33:57Z,use_quota=True,user_id='d2a61dc5eecd41bfa554e9442867b3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Creating volume 13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:01 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:01 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 1073741824 Apr 16 11:34:01 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2580b7d-0bdc-46c1-87a1-26c9f097efff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a117cbef-c390-4bd5-b33d-dfb499334009', 'volume_size': 1, 'snapshot_id': '3fda9e26-aad9-4ebc-b211-9971e54f91fa'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c597cda-2a11-483b-9278-eac85039c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:01 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Volume volume-a117cbef-c390-4bd5-b33d-dfb499334009 (a117cbef-c390-4bd5-b33d-dfb499334009): created successfully Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c597cda-2a11-483b-9278-eac85039c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:01 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (c4c23e93-15d4-4821-956d-b57da8e1affb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:01 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-e303af25-3b50-496c-a35e-e1ef7bed9d28 tempest-VolumeDependencyTests-316086749 None] Created volume successfully. Apr 16 11:34:02 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.436s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:02 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Deleted volume successfully. Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f31d0f42-cd8a-4759-a172-9ba962a4e956 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-3a2bb5cb-4944-4ee7-8c73-ae26efdd4a82-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (31876be7-3d3d-4593-ae97-40555a9b26c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c91562c-6e4e-4ecc-80ce-297a290541e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c91562c-6e4e-4ecc-80ce-297a290541e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200236136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d567336-d4f2-4eaa-a196-3d0ed0aad400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:02Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d443ae-3777-4e67-a0ba-042c1b0bfab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d443ae-3777-4e67-a0ba-042c1b0bfab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6cce44-38c5-4761-89b9-057c96f0679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6cce44-38c5-4761-89b9-057c96f0679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d567336-d4f2-4eaa-a196-3d0ed0aad400', 'volume_name': 'volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0ed1ab-cff2-4059-ac8e-fcce6797a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0ed1ab-cff2-4059-ac8e-fcce6797a93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0944e8-aef7-4899-9bcd-705c0b569038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:02 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume 2d567336-d4f2-4eaa-a196-3d0ed0aad400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400', 'volume_size': 1} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:02 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 1073741824" returned: 0 in 0.548s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:02 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 Apr 16 11:34:02 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-7c87a493-92fc-4e91-831e-2f83d3552d9d-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-7c87a493-92fc-4e91-831e-2f83d3552d9d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-quobyte-7c87a493-92fc-4e91-831e-2f83d3552d9d" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-7c87a493-92fc-4e91-831e-2f83d3552d9d" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1837ae38-5b21-4ea5-969f-fbd5d43d75e1]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:02 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d Apr 16 11:34:02 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-3fda9e26-aad9-4ebc-b211-9971e54f91fa-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-3fda9e26-aad9-4ebc-b211-9971e54f91fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-f3064a05-d54e-48f4-b096-c11cb9023034" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-f3064a05-d54e-48f4-b096-c11cb9023034" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-3fda9e26-aad9-4ebc-b211-9971e54f91fa" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-3fda9e26-aad9-4ebc-b211-9971e54f91fa" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Deleting offline snapshot 3fda9e26-aad9-4ebc-b211-9971e54f91fa of volume f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:34:02 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] snapshot_file for this snap is: volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4" returned: 0 in 0.491s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1a1d5-45d0-43fe-9df9-7ee9b993eef3]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200236136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d567336-d4f2-4eaa-a196-3d0ed0aad400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:02Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Creating volume 2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:02 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:02 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:02 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 1073741824 Apr 16 11:34:02 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530ef80-45c5-424e-9c9f-bb11213ae953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cb39ee-b602-40a0-8049-9e93c122c0c4', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810c875d-e432-414a-bccc-92b082d49257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:03 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Volume volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 (13cb39ee-b602-40a0-8049-9e93c122c0c4): created successfully Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810c875d-e432-414a-bccc-92b082d49257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Flow 'volume_create_manager' (3497d268-1b36-4a00-a673-1af1831fce1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:03 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa Apr 16 11:34:03 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:03 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5d5d66e0-74f2-40bf-8daa-39a18cefb340 tempest-SnapshotDependencyTests-1999265792 None] Created volume successfully. Apr 16 11:34:03 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d" returned: 0 in 0.524s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:03 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d Apr 16 11:34:03 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:03 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa" returned: 0 in 0.511s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3064a05-d54e-48f4-b096-c11cb9023034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402174d-a400-4e1e-9c64-5482698a71fa]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:03 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 1073741824" returned: 0 in 0.548s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:03 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 Apr 16 11:34:03 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:03 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 Apr 16 11:34:03 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:03 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-7c87a493-92fc-4e91-831e-2f83d3552d9d" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-7c87a493-92fc-4e91-831e-2f83d3552d9d" released by "delete_volume" :: held 1.051s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created reservations ['3c734cc4-4f35-438e-9107-19d685fb04e7', '59cc1161-c968-4d88-8db2-2cd185913a9c', '756c403b-c1aa-49b1-988d-a1c9e7785fd4', '70883389-0965-412d-a84f-15570ed0da68'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:03 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:03 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:03 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400" returned: 0 in 0.472s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:03 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.079s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0944e8-aef7-4899-9bcd-705c0b569038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9597f717-1227-4624-9c40-29b83f9ac9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Creating offline snapshot 38c4ce66-6df2-43bf-9c79-4e138b273f4f of volume 13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:34:04 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 (2d567336-d4f2-4eaa-a196-3d0ed0aad400): created successfully Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9597f717-1227-4624-9c40-29b83f9ac9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (31876be7-3d3d-4593-ae97-40555a9b26c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[63086faa-7ab6-41e4-ae1b-d9586143e45f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:04 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-fdc495a0-8b01-4001-bb61-aed0661a7cc7 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created volume successfully. Apr 16 11:34:04 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034" returned: 0 in 0.628s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:04 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa Apr 16 11:34:04 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:04 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 Apr 16 11:34:04 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:04 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.454s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:04 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Deleted volume successfully. Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f3a6bf90-3c28-49ff-b224-439d1541d194 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-7c87a493-92fc-4e91-831e-2f83d3552d9d-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:04 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4" returned: 0 in 0.553s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:04 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:04 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f 1G Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa" returned: 0 in 0.507s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:04 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:04 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa Apr 16 11:34:04 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-31761e51-665f-44e9-ac99-d507fd22f012-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-31761e51-665f-44e9-ac99-d507fd22f012-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-quobyte-31761e51-665f-44e9-ac99-d507fd22f012" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-31761e51-665f-44e9-ac99-d507fd22f012" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e34780-605a-40d2-8cae-b50a7a372c8f]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:04 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:05 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 Apr 16 11:34:05 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:05 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034.3fda9e26-aad9-4ebc-b211-9971e54f91fa" returned: 0 in 0.473s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:05 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f 1G" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:05 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f Apr 16 11:34:05 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-3fda9e26-aad9-4ebc-b211-9971e54f91fa" released by "_delete_snapshot" :: held 2.202s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-f3064a05-d54e-48f4-b096-c11cb9023034" released by "delete_snapshot" :: held 2.212s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Created reservations ['5dbcaf2d-2dcd-4738-835b-7fc29e29d9e6', '54e57b9d-3989-4fc4-9152-88e4502392e8', '9b90c63e-e2af-46e1-832b-35ce675f931f', 'e44172c5-76f8-4709-bf41-fbd1e085e9b5'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:05 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Delete snapshot completed successfully. Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-8d010f68-15d7-4ce6-bc80-a5d12b8598a6 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-3fda9e26-aad9-4ebc-b211-9971e54f91fa-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:05 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:05 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012 Apr 16 11:34:05 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:05 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f" returned: 0 in 0.447s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:05 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f is being set with open permissions: ugo+rw Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:05 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f Apr 16 11:34:05 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:05 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-31761e51-665f-44e9-ac99-d507fd22f012" returned: 0 in 0.399s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-31761e51-665f-44e9-ac99-d507fd22f012" released by "delete_volume" :: held 0.912s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created reservations ['b677767f-0b52-495d-81ce-cba9e7fd1839', '4735618c-eaf7-486c-90d3-96fbf388bfb3', 'c8859dd4-6012-4a67-9915-ef89becdf020', 'a0e2db67-46e5-45df-92cf-6f95d68e5cd5'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:05 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:05 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:06 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:06 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-a29e00ec-56b4-4214-9bfa-ca27f22f7348-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-f3064a05-d54e-48f4-b096-c11cb9023034-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-a29e00ec-56b4-4214-9bfa-ca27f22f7348-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:06 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.info Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-f3064a05-d54e-48f4-b096-c11cb9023034-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:06 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-quobyte-a29e00ec-56b4-4214-9bfa-ca27f22f7348" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-f3064a05-d54e-48f4-b096-c11cb9023034" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-a29e00ec-56b4-4214-9bfa-ca27f22f7348" acquired by "delete_volume" :: waited 0.018s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-f3064a05-d54e-48f4-b096-c11cb9023034" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b39d8b2-02e6-41a2-9bf1-27bff63a265a]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e211ab4-5279-4835-bddb-be53cfc44058]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:06 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 Apr 16 11:34:06 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:06 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 Apr 16 11:34:06 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:06 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.470s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:06 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Deleted volume successfully. Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-21bb675b-2073-4ca8-8544-9636f01b8275 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-31761e51-665f-44e9-ac99-d507fd22f012-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:06 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.info" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:06 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.info is being set with open permissions: ugo+rw Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:06 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.info Apr 16 11:34:06 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:06 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:06 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:06 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348 Apr 16 11:34:06 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034" returned: 0 in 0.497s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:06 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034 Apr 16 11:34:06 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:06 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.info" returned: 0 in 0.432s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.969s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.466s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:06 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Creating offline snapshot ae579dbb-cc43-411c-8e09-496757ff7cbd of volume 2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[159c98da-bda0-4210-8bb8-ff402f3e2681]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:07 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-93124d8e-433e-4918-8903-dc5e52492964 tempest-SnapshotDependencyTests-1999265792 None] Create snapshot completed successfully Apr 16 11:34:07 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 Apr 16 11:34:07 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:07 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f3064a05-d54e-48f4-b096-c11cb9023034" returned: 0 in 0.406s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:07 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a29e00ec-56b4-4214-9bfa-ca27f22f7348" returned: 0 in 0.439s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-f3064a05-d54e-48f4-b096-c11cb9023034" released by "delete_volume" :: held 0.942s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-a29e00ec-56b4-4214-9bfa-ca27f22f7348" released by "delete_volume" :: held 0.959s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Created reservations ['d427d6f1-a85d-4595-938e-d2d69a4005e8', 'c65668e5-8a18-400d-a5a7-3414f4a45933', '4d38cb7a-9a74-4c39-8285-243f658a9a16', 'e772d260-2adf-4047-aed2-7e505c855a91'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created reservations ['e106ca74-bee4-4cda-91e4-e4ba9555fba3', '88612a08-b53c-4685-aa45-2f57a3a2be09', '3a04000c-a3e5-465f-a229-8320fcd0b8fd', '6cf777de-4d4a-4c8f-b36c-4967e3074852'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:07 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:07 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:07 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:07 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:07 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400" returned: 0 in 0.513s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:07 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd 1G Apr 16 11:34:07 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:07 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.408s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:07 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Deleted volume successfully. Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-78c5b866-5512-4b9f-b899-7b7c537f81a1 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-f3064a05-d54e-48f4-b096-c11cb9023034-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:07 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.401s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:07 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Deleted volume successfully. Apr 16 11:34:07 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-975840bd-2b57-4203-a4a2-590c556f0c04 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-a29e00ec-56b4-4214-9bfa-ca27f22f7348-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:08 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd 1G" returned: 0 in 0.486s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:08 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd Apr 16 11:34:08 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-f461bf5b-5a44-4f48-aa82-d34b9c34cd69-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-f461bf5b-5a44-4f48-aa82-d34b9c34cd69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=172,cinder:UPDATE=250,cinder:DELETE=24,cinder:INSERT=50 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=164,cinder:UPDATE=228,cinder:INSERT=62,cinder:DELETE=20 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "cinder-quobyte-f461bf5b-5a44-4f48-aa82-d34b9c34cd69" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-f461bf5b-5a44-4f48-aa82-d34b9c34cd69" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8f553c-1a42-4ec5-9f44-fcbeb9378d52]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:08 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 Apr 16 11:34:08 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Flow 'volume_create_manager' (4c50bead-d67c-401d-b7b8-ac95391e0682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcfcc07-8dc7-491f-8987-4849372a3fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcfcc07-8dc7-491f-8987-4849372a3fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad856fc-0edb-4d3d-bdad-e179dc24410f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b2d4b731394dd3a2ec873da6d1bfa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38c4ce66-6df2-43bf-9c79-4e138b273f4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:08Z,use_quota=True,user_id='d2a61dc5eecd41bfa554e9442867b3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5f5d6f-0ab8-4d14-a447-19b684f59215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5f5d6f-0ab8-4d14-a447-19b684f59215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae6154f-93f2-4c88-be4b-5cf95d5567ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae6154f-93f2-4c88-be4b-5cf95d5567ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ad856fc-0edb-4d3d-bdad-e179dc24410f', 'volume_name': 'volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f', 'volume_size': 1, 'snapshot_id': '38c4ce66-6df2-43bf-9c79-4e138b273f4f'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587a0c78-dd4c-47ee-88cb-01f83eb64e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587a0c78-dd4c-47ee-88cb-01f83eb64e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89148466-1adb-4cfc-9608-040f5a7fb1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Volume 9ad856fc-0edb-4d3d-bdad-e179dc24410f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f', 'volume_size': 1, 'snapshot_id': '38c4ce66-6df2-43bf-9c79-4e138b273f4f'} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd" returned: 0 in 0.508s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:08 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd is being set with open permissions: ugo+rw Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:08 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd Apr 16 11:34:08 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (78425f53-11b8-4365-a5fd-e27ed3f28b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e3ceb5-e2be-4905-af30-3a04d79f2dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e3ceb5-e2be-4905-af30-3a04d79f2dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144281655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0af138e-992d-49f4-a684-f026cd5787c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a13b7eb97e441480e06b35829b5146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:09Z,use_quota=True,user_id='3abfa09ce1444f318f2d0be662bc4c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797baeaa-1a83-4cbc-91a9-38395021c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797baeaa-1a83-4cbc-91a9-38395021c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301d6ee0-e3bd-437a-b869-73409416175a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301d6ee0-e3bd-437a-b869-73409416175a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0af138e-992d-49f4-a684-f026cd5787c2', 'volume_name': 'volume-d0af138e-992d-49f4-a684-f026cd5787c2', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98193f6-d311-498e-8874-38bea2be7dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98193f6-d311-498e-8874-38bea2be7dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256f1a9e-bada-4ffd-957e-34930eeb4e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:08 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Volume d0af138e-992d-49f4-a684-f026cd5787c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0af138e-992d-49f4-a684-f026cd5787c2', 'volume_size': 1} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:08 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69" returned: 0 in 0.557s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:08 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69 Apr 16 11:34:08 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:08 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd" returned: 0 in 0.453s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:08 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:09 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.info Apr 16 11:34:09 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:09 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-f461bf5b-5a44-4f48-aa82-d34b9c34cd69" returned: 0 in 0.410s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-quobyte-f461bf5b-5a44-4f48-aa82-d34b9c34cd69" released by "delete_volume" :: held 0.990s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Created reservations ['894b0d93-8a71-4c04-baf0-c64431f7640d', '921cedde-4815-4f3c-a1a2-b88d9cf9f3b2', 'e2cee7b3-3407-492c-a761-b5f16a0cc321', '4616a5e3-ff6d-41f1-b61b-da0dd1faad53'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:09 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:09 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:09 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.info" returned: 0 in 0.439s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:09 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.info is being set with open permissions: ugo+rw Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:09 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.info Apr 16 11:34:09 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:09 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.406s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:09 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Deleted volume successfully. Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-983c9d52-8ad2-4023-becc-53972d98c719 tempest-CreateVolumesFromSourceVolumeTest-2097821176 None] Lock "cinder-f461bf5b-5a44-4f48-aa82-d34b9c34cd69-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:09 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.info" returned: 0 in 0.402s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.306s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-quobyte-38c4ce66-6df2-43bf-9c79-4e138b273f4f-9ad856fc-0edb-4d3d-bdad-e179dc24410f" by "_create_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-38c4ce66-6df2-43bf-9c79-4e138b273f4f-9ad856fc-0edb-4d3d-bdad-e179dc24410f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Creating volume 9ad856fc-0edb-4d3d-bdad-e179dc24410f from snapshot 38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-quobyte-9ad856fc-0edb-4d3d-bdad-e179dc24410f" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:09 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-81c9e531-6c79-4d5b-bb82-20f6f6b5c945 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Create snapshot completed successfully Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-9ad856fc-0edb-4d3d-bdad-e179dc24410f" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] snapshot: 38c4ce66-6df2-43bf-9c79-4e138b273f4f, volume: 9ad856fc-0edb-4d3d-bdad-e179dc24410f, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab7f67-db63-4ff7-b26d-eca22e6b2161]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:09 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:09 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f Apr 16 11:34:09 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:10 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f" returned: 0 in 0.476s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13cb39ee-b602-40a0-8049-9e93c122c0c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd19e21-9d83-42f8-820a-5d4007c54fda]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:10 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 Apr 16 11:34:10 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo_service.periodic_task [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83804) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:10 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:10 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:10 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:11 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (bd2c2e98-028a-44ef-be32-39e14f0bd80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8992756-b78e-432d-9380-add4d126dee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4" returned: 0 in 0.636s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8992756-b78e-432d-9380-add4d126dee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1998105895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9809b0f8-0ef1-453f-8222-0d303d3fd3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:11Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685085af-bf3b-4bf8-9821-6c7fdf27b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685085af-bf3b-4bf8-9821-6c7fdf27b677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f Apr 16 11:34:11 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19584a23-3ccf-4d2d-aaee-b5d5e9654644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19584a23-3ccf-4d2d-aaee-b5d5e9654644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9809b0f8-0ef1-453f-8222-0d303d3fd3bc', 'volume_name': 'volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ead938-d1f7-40dc-a099-253edc767239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ead938-d1f7-40dc-a099-253edc767239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b0dd7e-dc77-4b32-b779-87719b235568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume 9809b0f8-0ef1-453f-8222-0d303d3fd3bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc', 'volume_size': 1} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (658c72b7-204e-4468-b6c5-a9a3f1bb71a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1158b3fb-d1b2-4e27-9fe3-9b0c8386b29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1158b3fb-d1b2-4e27-9fe3-9b0c8386b29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602706570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fef51f-4726-4abc-926d-21a0eea8bda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:11Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe395b3-fef4-40ce-a092-6616216fc0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe395b3-fef4-40ce-a092-6616216fc0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a69e06-e2b7-44f4-8a14-0124f7751613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a69e06-e2b7-44f4-8a14-0124f7751613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fef51f-4726-4abc-926d-21a0eea8bda3', 'volume_name': 'volume-45fef51f-4726-4abc-926d-21a0eea8bda3', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f22304-84c8-47cf-9cfd-1159b79779ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f22304-84c8-47cf-9cfd-1159b79779ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58b8a30-6ff4-46a7-9fb2-0c0b60526f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume 45fef51f-4726-4abc-926d-21a0eea8bda3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fef51f-4726-4abc-926d-21a0eea8bda3', 'volume_size': 1} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:11 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.609s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-43e341f7-d225-41d0-8c2c-116163dc9f85 None None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (b5d37618-28a6-48d2-83bf-9a38143f37cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ea7583-1563-4d1c-ac09-2bf877079ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ea7583-1563-4d1c-ac09-2bf877079ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057521773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5b71cb-aaf4-4050-ad4c-3a58cbaec654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:12Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f206e7-928a-415b-810b-62e33072867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f206e7-928a-415b-810b-62e33072867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2516c8d-7527-47c6-9de8-c9f9ff3d3429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2516c8d-7527-47c6-9de8-c9f9ff3d3429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5b71cb-aaf4-4050-ad4c-3a58cbaec654', 'volume_name': 'volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983de47a-1541-47c6-9e98-58c7676c5fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983de47a-1541-47c6-9e98-58c7676c5fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e92746-292a-4f32-a09d-e714641ba3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:11 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume ff5b71cb-aaf4-4050-ad4c-3a58cbaec654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654', 'volume_size': 1} Apr 16 11:34:11 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (1d784d23-8b6a-4c7b-9113-8325e6d86023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f60a89b-7f68-458e-a1ec-b8c85f169589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f60a89b-7f68-458e-a1ec-b8c85f169589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-187345152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e4257-3ffa-4756-91fc-f5ef77327174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:12Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c73738-a8f8-4ef9-afc7-db0a1d90146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c73738-a8f8-4ef9-afc7-db0a1d90146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e094b1dc-8ffe-4c00-972c-942fba28df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e094b1dc-8ffe-4c00-972c-942fba28df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60e4257-3ffa-4756-91fc-f5ef77327174', 'volume_name': 'volume-d60e4257-3ffa-4756-91fc-f5ef77327174', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c99037-be02-42d8-90a6-b97ae12e6df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c99037-be02-42d8-90a6-b97ae12e6df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52277a27-bb14-47b1-ae8b-d230585c2eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume d60e4257-3ffa-4756-91fc-f5ef77327174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60e4257-3ffa-4756-91fc-f5ef77327174', 'volume_size': 1} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (e9580f9c-b907-4ee4-8450-ca726b5f9622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5307863e-48ce-4895-84c6-120b3f2f3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5307863e-48ce-4895-84c6-120b3f2f3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-631588033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6ab9d9-4d69-4260-9a10-3654743fe0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:13Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83be5ef-77d4-4282-bff2-07c9a667ee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83be5ef-77d4-4282-bff2-07c9a667ee0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0b0571-0e99-40f6-99cc-a41f7616efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0b0571-0e99-40f6-99cc-a41f7616efce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6ab9d9-4d69-4260-9a10-3654743fe0e9', 'volume_name': 'volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a3d8d-127b-42e2-88b2-ba6454e7b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a3d8d-127b-42e2-88b2-ba6454e7b281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0594a953-5d17-4066-841c-e19ea77c348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:12 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume 6b6ab9d9-4d69-4260-9a10-3654743fe0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9', 'volume_size': 1} Apr 16 11:34:12 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:13 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f" returned: 0 in 2.564s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Flow 'volume_create_manager' (05717b43-60be-4e67-adae-36f8eed132ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a752810-9dd6-4b43-9670-e409a2139c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1460be14-b580-4b6b-b050-1572752c6336]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a752810-9dd6-4b43-9670-e409a2139c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfed049-2f45-49ca-b2f1-0a457e372b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0784c3e2607d4eb8a68e0d75a80c8f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:14Z,use_quota=True,user_id='ce20a7daf4e94e3790cb64ef583bf800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01f412c-e473-4b4d-8d84-a6b5cf9a6988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01f412c-e473-4b4d-8d84-a6b5cf9a6988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e8ea93-99df-45e8-88bc-94e491496f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e8ea93-99df-45e8-88bc-94e491496f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bfed049-2f45-49ca-b2f1-0a457e372b59', 'volume_name': 'volume-8bfed049-2f45-49ca-b2f1-0a457e372b59', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24176fc-36cd-43c9-a0ca-d9a6f9fc1ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24176fc-36cd-43c9-a0ca-d9a6f9fc1ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7210b654-e7c7-4d87-a2b1-4778dbb783ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:13 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Volume 8bfed049-2f45-49ca-b2f1-0a457e372b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bfed049-2f45-49ca-b2f1-0a457e372b59', 'volume_size': 1} Apr 16 11:34:13 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:13 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 Apr 16 11:34:13 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:14 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4" returned: 0 in 0.569s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:34:14 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Converted 1024.00 MB image at 399.15 MB/s Apr 16 11:34:14 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f is being set with open permissions: ugo+rw Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:14 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f Apr 16 11:34:14 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:14 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f" returned: 0 in 0.404s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-9ad856fc-0edb-4d3d-bdad-e179dc24410f" released by "_copy_volume_from_snapshot" :: held 4.725s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-38c4ce66-6df2-43bf-9c79-4e138b273f4f-9ad856fc-0edb-4d3d-bdad-e179dc24410f" released by "_create_volume_from_snapshot" :: held 4.743s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.760s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.915s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144281655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0af138e-992d-49f4-a684-f026cd5787c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a13b7eb97e441480e06b35829b5146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:09Z,use_quota=True,user_id='3abfa09ce1444f318f2d0be662bc4c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Creating volume d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:14 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:14 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 1073741824 Apr 16 11:34:14 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89148466-1adb-4cfc-9608-040f5a7fb1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f', 'volume_size': 1, 'snapshot_id': '38c4ce66-6df2-43bf-9c79-4e138b273f4f'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60feb0ca-e5c8-4a68-abfe-e8d4e0025cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:14 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Volume volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f (9ad856fc-0edb-4d3d-bdad-e179dc24410f): created successfully Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60feb0ca-e5c8-4a68-abfe-e8d4e0025cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Flow 'volume_create_manager' (4c50bead-d67c-401d-b7b8-ac95391e0682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:14 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-24004390-6d61-4f36-a75f-30b6eee1c7b4 tempest-SnapshotDependencyTests-1999265792 None] Created volume successfully. Apr 16 11:34:14 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-38c4ce66-6df2-43bf-9c79-4e138b273f4f-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-38c4ce66-6df2-43bf-9c79-4e138b273f4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-quobyte-13cb39ee-b602-40a0-8049-9e93c122c0c4" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-13cb39ee-b602-40a0-8049-9e93c122c0c4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-quobyte-38c4ce66-6df2-43bf-9c79-4e138b273f4f" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-38c4ce66-6df2-43bf-9c79-4e138b273f4f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Deleting offline snapshot 38c4ce66-6df2-43bf-9c79-4e138b273f4f of volume 13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] snapshot_file for this snap is: volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[52981973-720d-42a6-b589-08a2251770c6]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:15 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f Apr 16 11:34:15 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:15 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 1073741824" returned: 0 in 0.517s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:15 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 Apr 16 11:34:15 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:15 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f" returned: 0 in 0.462s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13cb39ee-b602-40a0-8049-9e93c122c0c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a077cb-6700-4f2c-b39f-06c1f1caf6ee]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:15 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2" returned: 0 in 0.411s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.477s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1998105895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9809b0f8-0ef1-453f-8222-0d303d3fd3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:11Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Creating volume 9809b0f8-0ef1-453f-8222-0d303d3fd3bc {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:15 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:15 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 Apr 16 11:34:15 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256f1a9e-bada-4ffd-957e-34930eeb4e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0af138e-992d-49f4-a684-f026cd5787c2', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:15 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc 1073741824 Apr 16 11:34:15 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eec717e-051d-4847-8b2f-f1f60da40997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:15 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Volume volume-d0af138e-992d-49f4-a684-f026cd5787c2 (d0af138e-992d-49f4-a684-f026cd5787c2): created successfully Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eec717e-051d-4847-8b2f-f1f60da40997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:15 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (78425f53-11b8-4365-a5fd-e27ed3f28b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:15 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-941cd2f3-f4b3-49b7-b08d-9d1ee2f928b7 tempest-VolumeDependencyTests-316086749 None] Created volume successfully. Apr 16 11:34:16 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:16 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:16 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc 1073741824" returned: 0 in 0.484s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:16 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:16 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc Apr 16 11:34:16 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (f2c24024-b81d-443c-850b-33f27899a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6fc767-1980-4a84-89e9-9046dd2a35e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6fc767-1980-4a84-89e9-9046dd2a35e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1599308405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2160bd37-0788-4d1f-be92-2f66b7682b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a13b7eb97e441480e06b35829b5146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d0af138e-992d-49f4-a684-f026cd5787c2,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:16Z,use_quota=True,user_id='3abfa09ce1444f318f2d0be662bc4c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de97908-33c7-47a3-b8fa-7a317d34549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de97908-33c7-47a3-b8fa-7a317d34549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b7d451-6b0e-47ba-902a-3cf56bbfc91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b7d451-6b0e-47ba-902a-3cf56bbfc91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2160bd37-0788-4d1f-be92-2f66b7682b37', 'volume_name': 'volume-2160bd37-0788-4d1f-be92-2f66b7682b37', 'volume_size': 1, 'source_volid': 'd0af138e-992d-49f4-a684-f026cd5787c2', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528e4ca5-44e4-4d57-ac74-8d8192da643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528e4ca5-44e4-4d57-ac74-8d8192da643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:16 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8674dbf4-752d-4ae3-8d1d-d44a6ad3b815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:16 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Volume 2160bd37-0788-4d1f-be92-2f66b7682b37: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2160bd37-0788-4d1f-be92-2f66b7682b37', 'volume_size': 1, 'source_volid': 'd0af138e-992d-49f4-a684-f026cd5787c2', 'source_volstatus': 'available'} Apr 16 11:34:16 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc" returned: 0 in 0.471s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f" returned: 0 in 0.530s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.159s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602706570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fef51f-4726-4abc-926d-21a0eea8bda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:11Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Creating volume 45fef51f-4726-4abc-926d-21a0eea8bda3 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:16 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f Apr 16 11:34:16 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:16 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b0dd7e-dc77-4b32-b779-87719b235568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:16 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 1073741824 Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df4f5c4-d81a-464f-9234-5a095b6a2fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:16 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:16 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc (9809b0f8-0ef1-453f-8222-0d303d3fd3bc): created successfully Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df4f5c4-d81a-464f-9234-5a095b6a2fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (bd2c2e98-028a-44ef-be32-39e14f0bd80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:16 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-94a576d1-7231-4edc-8bf2-86f0fddfe186 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created volume successfully. Apr 16 11:34:16 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:16 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4.38c4ce66-6df2-43bf-9c79-4e138b273f4f" returned: 0 in 0.446s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-38c4ce66-6df2-43bf-9c79-4e138b273f4f" released by "_delete_snapshot" :: held 1.990s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-13cb39ee-b602-40a0-8049-9e93c122c0c4" released by "delete_snapshot" :: held 2.003s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:17 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 1073741824" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Created reservations ['9e2b1d48-a13e-428c-bfd4-e7f949073d00', '048c056c-1bc2-417e-9b11-713d82377fed', 'a0db51ba-d3bf-45dd-97fc-05c42a7060a4', '1b34676c-0731-419a-a30f-d1b264e5c50c'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:17 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 Apr 16 11:34:17 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:17 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Delete snapshot completed successfully. Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-b3274546-2eef-467e-9243-ea7b7037cd6f tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-38c4ce66-6df2-43bf-9c79-4e138b273f4f-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-13cb39ee-b602-40a0-8049-9e93c122c0c4-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-13cb39ee-b602-40a0-8049-9e93c122c0c4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-quobyte-13cb39ee-b602-40a0-8049-9e93c122c0c4" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-13cb39ee-b602-40a0-8049-9e93c122c0c4" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a21b32b-0b8a-434f-af9b-e2f890252f1d]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:17 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 Apr 16 11:34:17 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:17 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3" returned: 0 in 0.448s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.917s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057521773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5b71cb-aaf4-4050-ad4c-3a58cbaec654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:12Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Creating volume ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:17 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58b8a30-6ff4-46a7-9fb2-0c0b60526f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fef51f-4726-4abc-926d-21a0eea8bda3', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:17 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 1073741824 Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5632ba80-4c4a-4b14-a22e-151a4e58c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:17 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:17 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume volume-45fef51f-4726-4abc-926d-21a0eea8bda3 (45fef51f-4726-4abc-926d-21a0eea8bda3): created successfully Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5632ba80-4c4a-4b14-a22e-151a4e58c044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (658c72b7-204e-4468-b6c5-a9a3f1bb71a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:17 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-870ad0e4-85e7-45ac-8c93-ae9443272883 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created volume successfully. Apr 16 11:34:17 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4" returned: 0 in 0.472s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:17 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:17 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4 Apr 16 11:34:17 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:18 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 1073741824" returned: 0 in 0.493s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:18 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 Apr 16 11:34:18 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:18 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-13cb39ee-b602-40a0-8049-9e93c122c0c4" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-13cb39ee-b602-40a0-8049-9e93c122c0c4" released by "delete_volume" :: held 0.917s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Created reservations ['fc004eb5-329a-44e6-bcb0-f5430b71333c', 'ff25e425-8266-4e81-a161-e906ffda6e2b', 'fdc21738-ef54-4aa6-9d8b-0ddc69a4b104', 'a12188cf-2b16-44f6-b921-debd4cdd2bf2'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:18 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:18 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-9ad856fc-0edb-4d3d-bdad-e179dc24410f-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-9ad856fc-0edb-4d3d-bdad-e179dc24410f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "cinder-quobyte-9ad856fc-0edb-4d3d-bdad-e179dc24410f" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-9ad856fc-0edb-4d3d-bdad-e179dc24410f" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[071e2021-9e3a-4900-9f26-ee173fc6f507]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:18 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f Apr 16 11:34:18 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:18 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654" returned: 0 in 0.415s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.022s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-187345152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60e4257-3ffa-4756-91fc-f5ef77327174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:12Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Creating volume d60e4257-3ffa-4756-91fc-f5ef77327174 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:18 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e92746-292a-4f32-a09d-e714641ba3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2512a1f-054c-4806-9134-04263d47e791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:18 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 1073741824 Apr 16 11:34:18 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:18 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 (ff5b71cb-aaf4-4050-ad4c-3a58cbaec654): created successfully Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2512a1f-054c-4806-9134-04263d47e791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (b5d37618-28a6-48d2-83bf-9a38143f37cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f6d0a2ea-af9e-4335-ae39-5f3a1fa432e1 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created volume successfully. Apr 16 11:34:18 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.463s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:18 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Deleted volume successfully. Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-65a720af-4b14-4dd0-b3dc-ea5855afdf2d tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-13cb39ee-b602-40a0-8049-9e93c122c0c4-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:18 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f" returned: 0 in 0.495s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:18 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f Apr 16 11:34:18 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:18 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:18 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 1073741824" returned: 0 in 0.529s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:19 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 Apr 16 11:34:19 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:19 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9ad856fc-0edb-4d3d-bdad-e179dc24410f" returned: 0 in 0.412s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-quobyte-9ad856fc-0edb-4d3d-bdad-e179dc24410f" released by "delete_volume" :: held 0.938s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Created reservations ['50465c63-c4c2-48d0-8a75-90799b80cc70', '1a0f89f1-85ce-49a8-884e-19fcf21fd409', '6debe4eb-45ba-4af0-8066-f53ea7a56f9e', '9bb2358b-732e-477a-bde4-5ed952776626'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:19 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:19 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:19 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174" returned: 0 in 0.426s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.587s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-631588033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6ab9d9-4d69-4260-9a10-3654743fe0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='793b7a59b1874ffca7ccef7fae768712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:13Z,use_quota=True,user_id='b2a7772381144e69a579d7db46c53cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Creating volume 6b6ab9d9-4d69-4260-9a10-3654743fe0e9 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:19 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52277a27-bb14-47b1-ae8b-d230585c2eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60e4257-3ffa-4756-91fc-f5ef77327174', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421f0fe9-65c6-4a97-9b16-d2d38093341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:19 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 1073741824 Apr 16 11:34:19 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:19 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume volume-d60e4257-3ffa-4756-91fc-f5ef77327174 (d60e4257-3ffa-4756-91fc-f5ef77327174): created successfully Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421f0fe9-65c6-4a97-9b16-d2d38093341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (1d784d23-8b6a-4c7b-9113-8325e6d86023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:19 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-6a921e77-dfe7-41de-b3cf-0a3bb207c62c tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created volume successfully. Apr 16 11:34:19 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.446s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:19 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Deleted volume successfully. Apr 16 11:34:19 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-72993197-f43e-49ab-ab8a-c25f0993b4a4 tempest-SnapshotDependencyTests-1999265792 None] Lock "cinder-9ad856fc-0edb-4d3d-bdad-e179dc24410f-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:19 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 1073741824" returned: 0 in 0.542s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:20 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 Apr 16 11:34:20 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:20 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9" returned: 0 in 0.422s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.785s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfed049-2f45-49ca-b2f1-0a457e372b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0784c3e2607d4eb8a68e0d75a80c8f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:14Z,use_quota=True,user_id='ce20a7daf4e94e3790cb64ef583bf800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Creating volume 8bfed049-2f45-49ca-b2f1-0a457e372b59 {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:20 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0594a953-5d17-4066-841c-e19ea77c348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a68c199-20aa-4014-8123-33dda43e6659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:20 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 1073741824 Apr 16 11:34:20 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:20 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Volume volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 (6b6ab9d9-4d69-4260-9a10-3654743fe0e9): created successfully Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a68c199-20aa-4014-8123-33dda43e6659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Flow 'volume_create_manager' (e9580f9c-b907-4ee4-8450-ca726b5f9622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:20 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c0a9c12e-7532-427b-9bfe-0e171a4af400 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created volume successfully. Apr 16 11:34:20 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:20 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 1073741824" returned: 0 in 0.519s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:21 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 Apr 16 11:34:21 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-6b6ab9d9-4d69-4260-9a10-3654743fe0e9-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-6b6ab9d9-4d69-4260-9a10-3654743fe0e9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-6b6ab9d9-4d69-4260-9a10-3654743fe0e9" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-6b6ab9d9-4d69-4260-9a10-3654743fe0e9" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe785a0e-cc1a-42bd-a9cb-3665e023b641]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:21 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 Apr 16 11:34:21 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:21 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59" returned: 0 in 0.504s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.973s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:21 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Cloning volume d0af138e-992d-49f4-a684-f026cd5787c2 to volume 2160bd37-0788-4d1f-be92-2f66b7682b37 Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7210b654-e7c7-4d87-a2b1-4778dbb783ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfed049-2f45-49ca-b2f1-0a457e372b59', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7865d597-053a-40c8-b6ab-dbefce13fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Creating offline snapshot 7088d0c6-f4f0-4832-9f25-c9b426c7bce6 of volume d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:34:21 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Volume volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 (8bfed049-2f45-49ca-b2f1-0a457e372b59): created successfully Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7865d597-053a-40c8-b6ab-dbefce13fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Flow 'volume_create_manager' (05717b43-60be-4e67-adae-36f8eed132ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a52141-fe41-4be7-9a33-8fa3130038f4]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:21 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-551d7abe-3fa9-4310-ae28-e4faeeb27bbc tempest-CinderUnicodeTest-580698958 None] Created volume successfully. Apr 16 11:34:21 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 Apr 16 11:34:21 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:21 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9" returned: 0 in 0.560s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:21 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:21 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9 Apr 16 11:34:21 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:22 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2" returned: 0 in 0.608s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:22 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 1G Apr 16 11:34:22 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:22 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-6b6ab9d9-4d69-4260-9a10-3654743fe0e9" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-6b6ab9d9-4d69-4260-9a10-3654743fe0e9" released by "delete_volume" :: held 1.070s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.flows.manager.create_volume [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83804) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Flow 'volume_create_manager' (49420721-2139-4aa7-8f23-39b7e2ba9061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e5771-bc72-46e3-9fc6-f902134d070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e5771-bc72-46e3-9fc6-f902134d070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-438923089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88645677-f8d3-4b6e-b068-0c003cc9ca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0784c3e2607d4eb8a68e0d75a80c8f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:22Z,use_quota=True,user_id='ce20a7daf4e94e3790cb64ef583bf800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ccc4d5-bbb5-4f52-919f-1c26297fe7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ccc4d5-bbb5-4f52-919f-1c26297fe7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af84b356-4424-43bf-a508-5e7aa9c885d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af84b356-4424-43bf-a508-5e7aa9c885d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88645677-f8d3-4b6e-b068-0c003cc9ca5c', 'volume_name': 'volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efa899a-71f2-44d5-a7f0-1e758f464a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efa899a-71f2-44d5-a7f0-1e758f464a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ed7369-81a6-492e-a46c-9ccbbe5eed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:22 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Volume 88645677-f8d3-4b6e-b068-0c003cc9ca5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c', 'volume_size': 1} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created reservations ['43fd96cb-56ef-4afc-a366-a48a34d82cf2', 'e36a73ea-b627-4252-a0fe-b594e772d390', '23e16660-83f5-429a-ba77-5da1398b54ca', '686a6333-15d3-4275-a72d-656678cc7630'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:22 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:22 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:22 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 1G" returned: 0 in 0.532s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0af138e-992d-49f4-a684-f026cd5787c2 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:22 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0af138e-992d-49f4-a684-f026cd5787c2 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 Apr 16 11:34:22 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:22 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.478s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:22 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Deleted volume successfully. Apr 16 11:34:22 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2ec6eac3-73b1-4a98-a2c1-ccf698cbb84b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-6b6ab9d9-4d69-4260-9a10-3654743fe0e9-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:23 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0af138e-992d-49f4-a684-f026cd5787c2 -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:23 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 is being set with open permissions: ugo+rw Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:23 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 Apr 16 11:34:23 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-d60e4257-3ffa-4756-91fc-f5ef77327174-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-d60e4257-3ffa-4756-91fc-f5ef77327174-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-d60e4257-3ffa-4756-91fc-f5ef77327174" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-d60e4257-3ffa-4756-91fc-f5ef77327174" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f40b0d-8d0a-4b71-b46f-16bd9a6d50b5]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:23 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 Apr 16 11:34:23 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:23 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6" returned: 0 in 0.440s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:23 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.info Apr 16 11:34:23 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:23 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174" returned: 0 in 0.531s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:23 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:24 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174 Apr 16 11:34:24 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:24 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.info" returned: 0 in 0.492s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:24 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.info is being set with open permissions: ugo+rw Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:24 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.info Apr 16 11:34:24 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:24 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d60e4257-3ffa-4756-91fc-f5ef77327174" returned: 0 in 0.486s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-d60e4257-3ffa-4756-91fc-f5ef77327174" released by "delete_volume" :: held 1.038s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created reservations ['279b0426-970e-4b27-b2b9-deccd5565107', 'b2b192dc-1581-4245-9b7a-b9067514a5cd', '1c192205-7a50-4845-87e8-8859f0c68513', 'b062bdf6-520b-48f7-bcc7-ae8884c22433'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:24 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:24 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:24 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.info" returned: 0 in 0.521s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-2160bd37-0788-4d1f-be92-2f66b7682b37" by "_copy_volume_from_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-2160bd37-0788-4d1f-be92-2f66b7682b37" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] snapshot: 7088d0c6-f4f0-4832-9f25-c9b426c7bce6, volume: 2160bd37-0788-4d1f-be92-2f66b7682b37, {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd09ae-f3f5-4682-9418-540ff25ec244]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:24 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:24 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 Apr 16 11:34:24 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:25 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.539s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:25 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Deleted volume successfully. Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5c25bd8a-3e80-4f75-a6c6-a4fd8a7b3d76 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-d60e4257-3ffa-4756-91fc-f5ef77327174-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:25 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6" returned: 0 in 0.519s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0af138e-992d-49f4-a684-f026cd5787c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Creating direct copy from snapshot {{(pid=83804) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed50247-1e5d-4d2a-8975-ad39e5bb4198]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:25 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 Apr 16 11:34:25 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f17506e-10ac-4cd4-bc5c-d9858bad7af7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:25 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 Apr 16 11:34:25 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:25 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2" returned: 0 in 0.537s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG cinder.utils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Path /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 not found in is_blk_device check {{(pid=83804) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 11:34:25 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:25 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 Apr 16 11:34:25 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:26 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654" returned: 0 in 0.482s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:26 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:26 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654 Apr 16 11:34:26 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:27 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654" returned: 0 in 0.950s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654" released by "delete_volume" :: held 1.457s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created reservations ['fb781f7e-0cf1-41b0-aa52-787a67505547', 'b9e96ff4-8a58-468b-b59a-76f1f4a1b4d2', 'ad65b477-b119-457c-a2a9-213a22ae934c', 'a5a296f2-94ed-4fc0-a2ee-3779dde16f03'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:27 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:27 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-45fef51f-4726-4abc-926d-21a0eea8bda3-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-45fef51f-4726-4abc-926d-21a0eea8bda3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-45fef51f-4726-4abc-926d-21a0eea8bda3" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-45fef51f-4726-4abc-926d-21a0eea8bda3" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:27 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37" returned: 0 in 2.086s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[83028f37-ce4e-4a51-9ad8-b97dda00bb16]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[c795e610-cde9-4cc7-b86f-9c8b63229ac8]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:27 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 Apr 16 11:34:27 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:27 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 Apr 16 11:34:27 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:27 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.768s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:27 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Deleted volume successfully. Apr 16 11:34:27 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-a554f53c-3ee2-42a9-a413-acbb1ddc7107 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-ff5b71cb-aaf4-4050-ad4c-3a58cbaec654-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:28 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3" returned: 0 in 0.483s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:28 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3 Apr 16 11:34:28 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:28 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2" returned: 0 in 0.600s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.image.image_utils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Image conversion details: src /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 {{(pid=83804) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 11:34:28 devstack cinder-volume[83804]: INFO cinder.image.image_utils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Converted 1024.00 MB image at 490.60 MB/s Apr 16 11:34:28 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 is being set with open permissions: ugo+rw Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:28 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 Apr 16 11:34:28 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:28 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-45fef51f-4726-4abc-926d-21a0eea8bda3" returned: 0 in 0.417s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-45fef51f-4726-4abc-926d-21a0eea8bda3" released by "delete_volume" :: held 0.939s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created reservations ['0115dd06-b802-4061-9b2b-56a68111fa9a', 'daba5a15-c611-4816-abf3-7a0567fd2025', 'e17175bf-7ddf-42cd-be85-88896f66b628', '8937f206-e2f5-4ce9-8dd4-e4d4c9549cdc'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:28 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:28 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:28 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37" returned: 0 in 0.425s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-2160bd37-0788-4d1f-be92-2f66b7682b37" released by "_copy_volume_from_snapshot" :: held 4.225s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-7088d0c6-f4f0-4832-9f25-c9b426c7bce6" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-9809b0f8-0ef1-453f-8222-0d303d3fd3bc-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-7088d0c6-f4f0-4832-9f25-c9b426c7bce6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Deleting offline snapshot 7088d0c6-f4f0-4832-9f25-c9b426c7bce6 of volume d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] snapshot_file for this snap is: volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[954771bd-63ed-4c26-bbc5-bc7958ccfcef]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-9809b0f8-0ef1-453f-8222-0d303d3fd3bc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-9809b0f8-0ef1-453f-8222-0d303d3fd3bc" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:28 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-9809b0f8-0ef1-453f-8222-0d303d3fd3bc" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1e9e6f-a351-4251-ba9f-9f243276c777]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:29 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 Apr 16 11:34:29 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:29 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc Apr 16 11:34:29 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:29 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.468s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:29 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Deleted volume successfully. Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-5f0258a8-a7ff-4e0e-8985-df5e838d8591 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-45fef51f-4726-4abc-926d-21a0eea8bda3-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:29 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6" returned: 0 in 0.487s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0af138e-992d-49f4-a684-f026cd5787c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdbb95a-4068-40be-9bf8-e7430a1f3213]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:29 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc" returned: 0 in 0.467s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:29 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc Apr 16 11:34:29 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:29 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 Apr 16 11:34:29 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:29 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-9809b0f8-0ef1-453f-8222-0d303d3fd3bc" returned: 0 in 0.414s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-9809b0f8-0ef1-453f-8222-0d303d3fd3bc" released by "delete_volume" :: held 0.900s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:29 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2" returned: 0 in 0.464s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:29 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 Apr 16 11:34:29 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created reservations ['e81af346-450c-4968-9096-52413e2b1191', '5b7eb326-b83c-415f-bb5d-8ff8a345fe35', '03f8d836-ad5d-482b-8c2b-ccb848885597', '8e22798d-3e89-4d0f-80cf-4c0a5c016341'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:29 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:30 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:30 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-ae579dbb-cc43-411c-8e09-496757ff7cbd-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-ae579dbb-cc43-411c-8e09-496757ff7cbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-2d567336-d4f2-4eaa-a196-3d0ed0aad400" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-2d567336-d4f2-4eaa-a196-3d0ed0aad400" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-ae579dbb-cc43-411c-8e09-496757ff7cbd" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-ae579dbb-cc43-411c-8e09-496757ff7cbd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Deleting offline snapshot ae579dbb-cc43-411c-8e09-496757ff7cbd of volume 2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] snapshot_file for this snap is: volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[5231a72d-1138-4bd9-a421-f136104dbd82]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:30 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd Apr 16 11:34:30 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:30 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6" returned: 0 in 0.489s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:30 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.441s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:30 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6 Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:30 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Deleted volume successfully. Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-55b9259a-a4d8-4235-ba16-fe8b1605aa2b tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-9809b0f8-0ef1-453f-8222-0d303d3fd3bc-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:30 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd" returned: 0 in 0.490s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d15f60-c5cb-4e02-a2ce-7caab64d8498]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:30 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 Apr 16 11:34:30 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:30 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2.7088d0c6-f4f0-4832-9f25-c9b426c7bce6" returned: 0 in 0.420s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-7088d0c6-f4f0-4832-9f25-c9b426c7bce6" released by "_delete_snapshot" :: held 1.907s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.347s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.478s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T09:34:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-438923089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88645677-f8d3-4b6e-b068-0c003cc9ca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0784c3e2607d4eb8a68e0d75a80c8f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T09:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T09:34:22Z,use_quota=True,user_id='ce20a7daf4e94e3790cb64ef583bf800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab2e493-7b05-404a-ae2a-5f451830b5e1),volume_type_id=8ab2e493-7b05-404a-ae2a-5f451830b5e1)}" {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Creating volume 88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Selected osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 as target Quobyte volume. {{(pid=83804) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 11:34:30 devstack cinder-volume[83804]: INFO cinder.volume.drivers.remotefs [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] casted to osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253 Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c 1073741824 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8674dbf4-752d-4ae3-8d1d-d44a6ad3b815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2160bd37-0788-4d1f-be92-2f66b7682b37', 'volume_size': 1, 'source_volid': 'd0af138e-992d-49f4-a684-f026cd5787c2', 'source_volstatus': 'available'}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce93593-75f6-41aa-b513-12f04a75179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:30 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c 1073741824 Apr 16 11:34:30 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:30 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Volume volume-2160bd37-0788-4d1f-be92-2f66b7682b37 (2160bd37-0788-4d1f-be92-2f66b7682b37): created successfully Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce93593-75f6-41aa-b513-12f04a75179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:30 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Flow 'volume_create_manager' (f2c24024-b81d-443c-850b-33f27899a306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:30 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-900b16dc-9b64-438c-a813-64ed8dc9a15a tempest-VolumeDependencyTests-316086749 None] Created volume successfully. Apr 16 11:34:31 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400" returned: 0 in 0.498s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:31 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd Apr 16 11:34:31 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-d0af138e-992d-49f4-a684-f026cd5787c2-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-d0af138e-992d-49f4-a684-f026cd5787c2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-d0af138e-992d-49f4-a684-f026cd5787c2" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-d0af138e-992d-49f4-a684-f026cd5787c2" acquired by "delete_volume" :: waited 0.011s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d97c6f-2dc9-4bd9-829e-1bf043c60834]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:31 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 Apr 16 11:34:31 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:31 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c 1073741824" returned: 0 in 0.550s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:31 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c Apr 16 11:34:31 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:31 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd" returned: 0 in 0.519s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:31 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd Apr 16 11:34:31 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:31 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2" returned: 0 in 0.488s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:31 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2 Apr 16 11:34:31 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:31 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c" returned: 0 in 0.455s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'} {{(pid=83804) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ed7369-81a6-492e-a46c-9ccbbe5eed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c', 'volume_size': 1}' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2745f77b-97cf-45e0-bfbf-fd79f5bc8c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 11:34:31 devstack cinder-volume[83804]: INFO cinder.volume.flows.manager.create_volume [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Volume volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c (88645677-f8d3-4b6e-b068-0c003cc9ca5c): created successfully Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2745f77b-97cf-45e0-bfbf-fd79f5bc8c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83804) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 11:34:31 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Flow 'volume_create_manager' (49420721-2139-4aa7-8f23-39b7e2ba9061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83804) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 11:34:31 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-99003865-6426-4088-8e05-24c5cfada87d tempest-CinderUnicodeTest-580698958 None] Created volume successfully. Apr 16 11:34:32 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400.ae579dbb-cc43-411c-8e09-496757ff7cbd" returned: 0 in 0.423s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-ae579dbb-cc43-411c-8e09-496757ff7cbd" released by "_delete_snapshot" :: held 1.978s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-2d567336-d4f2-4eaa-a196-3d0ed0aad400" released by "delete_snapshot" :: held 1.987s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created reservations ['7d0c81b0-0aeb-4cc3-b58e-59dff6c02d6e', '9b14864a-3274-4ee7-a918-2372582576df', 'd06e4bd4-2b99-41af-9a27-2455df27549a', '7f0c056e-afec-43a3-b5ec-51027558bc4a'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Delete snapshot completed successfully. Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-eb60c060-de53-4d20-8c9e-77a59c5ce325 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-ae579dbb-cc43-411c-8e09-496757ff7cbd-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-2d567336-d4f2-4eaa-a196-3d0ed0aad400-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-2d567336-d4f2-4eaa-a196-3d0ed0aad400-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "cinder-quobyte-2d567336-d4f2-4eaa-a196-3d0ed0aad400" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-2d567336-d4f2-4eaa-a196-3d0ed0aad400" acquired by "delete_volume" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231b0cb-e3c8-43b0-a05f-cea93be02284]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:32 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-d0af138e-992d-49f4-a684-f026cd5787c2" returned: 0 in 0.445s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-d0af138e-992d-49f4-a684-f026cd5787c2" released by "delete_volume" :: held 0.961s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:32 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 Apr 16 11:34:32 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Created reservations ['526ce757-96fc-4a3c-94ec-ef7cb29ba2fb', 'ab80b465-33dd-4cc6-b811-87ef27ab2fca', 'a1309287-886f-4a24-8371-4f74ee23d16e', 'e6b5ebab-a3b5-45bb-b415-cb3d471de802'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:32 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:32 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:32 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400" returned: 0 in 0.477s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:32 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400 Apr 16 11:34:32 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:32 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.409s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:32 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Deleted volume successfully. Apr 16 11:34:32 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-c4b789a1-4eaf-4343-a912-2f133daa2894 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-d0af138e-992d-49f4-a684-f026cd5787c2-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:33 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2d567336-d4f2-4eaa-a196-3d0ed0aad400" returned: 0 in 0.418s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-quobyte-2d567336-d4f2-4eaa-a196-3d0ed0aad400" released by "delete_volume" :: held 0.930s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Creating offline snapshot d5c99133-8ca4-4702-9862-4aaf4d5c2871 of volume 88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bbcc0b-428c-4ee5-b318-ce2e1eadde03]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Created reservations ['1fa90d5e-bded-4cb9-adec-eeadf2641ab4', 'b069c10b-3db7-4e4a-8f35-1a9af375286c', 'dfc0390c-2189-4164-9ee6-8a9303682270', 'f1567c2f-454a-47cf-9995-cb01e0fe6b98'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:33 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c Apr 16 11:34:33 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:33 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:33 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-2160bd37-0788-4d1f-be92-2f66b7682b37-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-2160bd37-0788-4d1f-be92-2f66b7682b37-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-2160bd37-0788-4d1f-be92-2f66b7682b37" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-2160bd37-0788-4d1f-be92-2f66b7682b37" acquired by "delete_volume" :: waited 0.007s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deaa013-1db0-4c61-9b63-8d9ee21c479b]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:33 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 Apr 16 11:34:33 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:33 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.503s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:33 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Deleted volume successfully. Apr 16 11:34:33 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-f6c4551f-1aa8-48d8-9d04-2e10931c7b05 tempest-CreateVolumesFromSnapshotTest-1981755007 None] Lock "cinder-2d567336-d4f2-4eaa-a196-3d0ed0aad400-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c" returned: 0 in 0.597s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:33 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 1G {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:33 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 1G Apr 16 11:34:33 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:34 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37" returned: 0 in 0.586s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:34 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37 Apr 16 11:34:34 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:34 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 1G" returned: 0 in 0.567s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:34 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 Apr 16 11:34:34 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:34 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-2160bd37-0788-4d1f-be92-2f66b7682b37" returned: 0 in 0.440s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-2160bd37-0788-4d1f-be92-2f66b7682b37" released by "delete_volume" :: held 1.047s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Created reservations ['de62348f-698e-454b-ac53-1431d815a520', '7caa8df9-d945-4227-baa3-d6fe4b1b4751', '838da9ad-844b-47a5-895f-d736e711d9ca', 'e156cc61-f97e-42f6-949a-0889998fdeca'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:34 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:34 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:34 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c -F qcow2 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871" returned: 0 in 0.423s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:34 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 is being set with open permissions: ugo+rw Apr 16 11:34:34 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:34 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 Apr 16 11:34:34 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:35 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.433s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:35 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Deleted volume successfully. Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-0bddacc6-567f-4efe-b396-31e296cbe626 tempest-VolumeDependencyTests-316086749 None] Lock "cinder-2160bd37-0788-4d1f-be92-2f66b7682b37-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:35 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871" returned: 0 in 0.401s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:35 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.info Apr 16 11:34:35 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:35 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.info" returned: 0 in 0.419s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:35 devstack cinder-volume[83804]: WARNING cinder.volume.drivers.remotefs [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.info is being set with open permissions: ugo+rw Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.info {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:35 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.info Apr 16 11:34:35 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-a117cbef-c390-4bd5-b33d-dfb499334009-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Lock "cinder-a117cbef-c390-4bd5-b33d-dfb499334009-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Acquiring lock "cinder-quobyte-a117cbef-c390-4bd5-b33d-dfb499334009" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-a117cbef-c390-4bd5-b33d-dfb499334009" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb41a28-6a8b-42e6-b55a-3184a1d80830]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:35 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:35 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 Apr 16 11:34:35 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:36 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.info" returned: 0 in 0.437s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.911s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:36 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-9480c084-c509-4841-bdb9-72cab9354fa5 tempest-CinderUnicodeTest-580698958 None] Create snapshot completed successfully Apr 16 11:34:36 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009" returned: 0 in 0.475s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:36 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009 Apr 16 11:34:36 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Acquiring lock "cinder-d5c99133-8ca4-4702-9862-4aaf4d5c2871-delete_snapshot" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-d5c99133-8ca4-4702-9862-4aaf4d5c2871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Acquiring lock "cinder-quobyte-88645677-f8d3-4b6e-b068-0c003cc9ca5c" by "delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-88645677-f8d3-4b6e-b068-0c003cc9ca5c" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Acquiring lock "cinder-quobyte-d5c99133-8ca4-4702-9862-4aaf4d5c2871" by "_delete_snapshot" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-d5c99133-8ca4-4702-9862-4aaf4d5c2871" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Deleting offline snapshot d5c99133-8ca4-4702-9862-4aaf4d5c2871 of volume 88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] snapshot_file for this snap is: volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 {{(pid=83804) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b12a29d-f13f-48a9-b585-7a74da22c2e7]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:36 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 Apr 16 11:34:36 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:36 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-a117cbef-c390-4bd5-b33d-dfb499334009" returned: 0 in 0.434s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Lock "cinder-quobyte-a117cbef-c390-4bd5-b33d-dfb499334009" released by "delete_volume" :: held 0.929s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Created reservations ['d3194345-c880-4e45-9819-a2c7d944cc6f', '23ce2dfd-c44b-4125-8034-50d3eab9f832', 'afef4bab-3875-4fd3-babe-1cf5f32ae4df', 'f262698a-51dc-4f33-8505-8758f4dc82ca'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:36 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:36 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:36 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871" returned: 0 in 0.498s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.remotefs [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83804) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ef9584-eb2d-46f3-bb36-248d65655043]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:36 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:36 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c Apr 16 11:34:36 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:37 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.453s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:37 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:37 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Deleted volume successfully. Apr 16 11:34:37 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-28cc6ac9-f4f5-4d8a-ac13-021887a6740d tempest-VolumeDependencyTests-316086749 None] Lock "cinder-a117cbef-c390-4bd5-b33d-dfb499334009-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:37 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c" returned: 0 in 0.533s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:37 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 Apr 16 11:34:37 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:37 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871" returned: 0 in 0.502s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:37 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:37 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871 Apr 16 11:34:37 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:38 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c.d5c99133-8ca4-4702-9862-4aaf4d5c2871" returned: 0 in 0.395s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-d5c99133-8ca4-4702-9862-4aaf4d5c2871" released by "_delete_snapshot" :: held 1.987s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-88645677-f8d3-4b6e-b068-0c003cc9ca5c" released by "delete_snapshot" :: held 1.997s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Created reservations ['610d9899-d6fb-499c-95e1-a8bd7cea357e', '5213bf6e-cf97-441d-a9c8-a5cb193ab87d', '1aea557f-ff29-4456-84c5-73093b215cdd', '845fb6a8-f79e-4da3-a852-ed1fc13e9e05'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:38 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Delete snapshot completed successfully. Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-60c8e7be-fd2c-415d-ae7b-1852b5d937d2 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-d5c99133-8ca4-4702-9862-4aaf4d5c2871-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Acquiring lock "cinder-88645677-f8d3-4b6e-b068-0c003cc9ca5c-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Lock "cinder-88645677-f8d3-4b6e-b068-0c003cc9ca5c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Acquiring lock "cinder-quobyte-88645677-f8d3-4b6e-b068-0c003cc9ca5c" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-88645677-f8d3-4b6e-b068-0c003cc9ca5c" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8d4bfe-ac26-4f52-a719-839f3cde3c51]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:38 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c Apr 16 11:34:38 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:38 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c" returned: 0 in 0.454s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:38 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:38 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c Apr 16 11:34:38 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:39 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-88645677-f8d3-4b6e-b068-0c003cc9ca5c" returned: 0 in 0.402s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-88645677-f8d3-4b6e-b068-0c003cc9ca5c" released by "delete_volume" :: held 0.895s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Created reservations ['6a39508d-ba7f-40f6-bf85-570ec6642d79', 'd1b0a326-b6ae-4744-a4bd-471d8120fd88', 'f61b2d73-be2c-4ba0-8c9e-f69ec32a9f39', 'a7473dd3-0911-4d71-8bd0-ecd0eab919e3'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:39 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:39 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Acquiring lock "cinder-8bfed049-2f45-49ca-b2f1-0a457e372b59-delete_volume" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-8bfed049-2f45-49ca-b2f1-0a457e372b59-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Acquiring lock "cinder-quobyte-8bfed049-2f45-49ca-b2f1-0a457e372b59" by "delete_volume" {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-8bfed049-2f45-49ca-b2f1-0a457e372b59" acquired by "delete_volume" :: waited 0.008s {{(pid=83804) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cef64e-77d1-4de1-b698-e1fc8f148645]: (4, 'qcow2') {{(pid=84608) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:39 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 Apr 16 11:34:39 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:39 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.422s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:39 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Deleted volume successfully. Apr 16 11:34:39 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-2db28ccb-f74b-4f49-a161-7dabb99e3e5a tempest-CinderUnicodeTest-580698958 None] Lock "cinder-88645677-f8d3-4b6e-b068-0c003cc9ca5c-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:40 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59" returned: 0 in 0.465s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:40 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59 Apr 16 11:34:40 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:40 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d/volume-8bfed049-2f45-49ca-b2f1-0a457e372b59" returned: 0 in 0.408s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-quobyte-8bfed049-2f45-49ca-b2f1-0a457e372b59" released by "delete_volume" :: held 0.893s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG cinder.quota [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Created reservations ['186bb916-a580-4964-876f-ff52f80b9c4e', '7c93f183-2384-4aaa-92e2-c6178b7c4c55', '6df2221e-a47d-4a24-b359-0ee173858272', 'efd5817b-48f3-4148-938e-a786f0edd223'] {{(pid=83804) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253': None} {{(pid=83804) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5f85587f-0695-439f-adc9-d2d5f05f8253'] {{(pid=83804) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83804) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 11:34:40 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d Apr 16 11:34:40 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 11:34:40 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG oslo_concurrency.processutils [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0d9746397fda3811e10fcebe6bc5259d" returned: 0 in 0.438s {{(pid=83804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG cinder.manager [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Notifying Schedulers of capabilities ... {{(pid=83804) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 11:34:40 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Deleted volume successfully. Apr 16 11:34:40 devstack cinder-volume[83804]: DEBUG cinder.coordination [None req-9ffc6ba4-846a-44fe-a3db-26ddf51770e9 tempest-CinderUnicodeTest-580698958 None] Lock "cinder-8bfed049-2f45-49ca-b2f1-0a457e372b59-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=83804) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 11:34:50 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=106,cinder:UPDATE=161,cinder:INSERT=27,cinder:DELETE=13 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 11:34:50 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:UPDATE=161,cinder:SELECT=125,cinder:INSERT=54,cinder:DELETE=13 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}